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ABSTRACT 


The technique of component curve analysis as developed by Ledyard 
Tucker was applied to data from computer-assisted drill in arithmetic. 
Twenty-one second grade students participated in seven sessions of drill 
over the course of two weeks. 

A scoring system was devised which weighted answers with response 
latencies. The component curve analysis of these scores produced three 
components. The first was found to relate to initial ability in arithmetic 
as measured by a pre-test, to IQ, to the score on the Gates-MacGinitie 
Reading Test, and to performance on a digit span test. This first com- 
ponent was interpreted as general ability in arithmetic. The second 
component was related to attention as measured on a second computer task 
designed to yield a measure of the level of attention at various points 
throughout the drill sessions. The third component could not be ade- 
quately identified. 

A discussion of some of the outstanding problems with the technique 
of component curve analysis was included in the paper. It was concluded 
that the results from the limited set of data of this study indicate that 
the technique has great potential in the investigation of individual 


differences in learning. 
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CHAPTER I 


INTRODUCTION 


This paper presents an analysis of the data from seven sessions 
of computer-assisted drill in arithmetic. Twenty-one second grade stu- 
dents worked thirty minutes a day on simple mathematical expressions of 
the form a+b =c. The purpose of this paper is not to extract results 
of global significance from these limited data. Rather the purpose is 
to provide an example of a method of data analysis which appears to have 
considerable promise as a means of identifying individual parameters of 
performance in learning tasks. 

Whenever learning data are analyzed, there is a great temptation 
to employ curves of some sort to illustrate what has taken place. With 
data from computer-assisted instruction, the temptation is even greater 
for the computer itself can perform what calculations are necessary and 
then display the curves. Unfortunately, many types of learning curves 
have been shown to give a distorted picture of the learning process. 
Perhaps the most vital criticism of traditional learning curves (which 
are based on averages of one kind or another) is that they obscure indi- 
vidual differences and, in fact, may not represent any individual very 
well. If the purpose in using computer-assisted drill is to provide 
individual instruction, then any method of analysis which obscures 
individual differences has limited value. Still the mass of data which 
the computer can process and display must be reduced to a manageable 


subset. 
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In 1960, Ledyard Tucker introduced the method of component curve 
analysis which gives promise of resolving some of these problems. In 
effect the method calls for a component analysis of the learning data 
to determine the significant components. The components are easily 
interpretable as curves. Thus instead of using one average curve to 
describe the data, as many curves as may be necessary to account for the 
individual differences are employed. A score for an individual becomes 
a weighted sum of the various component curves. If the components can 
be identified by their correlations with independent reference variables, 
then it is possible to identify what underlies each individual's per- 
formance. For instance, if one of the components extracted from the 
arithmetic drill data is seen to represent numerical aptitude and another 
component the level of attention, then an examination of the individual 
weights for each student on each of the components could indicate which 
low scores were the result of inability and which of boredom. 

This paper then, examines in detail the method of component curve 
analysis and applies the method to the data from an arithmetic drill. 
The results obtained are not generalized beyond the group of students 
who participated in the study. The purpose of the study is to examine 
the feasibility of this method of data analysis with a small sample. If 
the method of component curve analysis is seen to yield meaningful 
results from a small sample over a short period of time, then it can 
reasonably be expected to yield more stable and useful results from more 
comprehensive data. 


Chapter II gives a review of some of the research that has been 
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done in computer-assisted drill in arithmetic. A summary of the criti- 
cisms of traditional learning curves is included followed by a descrip- 
tion of the method of component curve analysis and a brief summary of 
some of the unresolved problems with the technique. 

A detailed description of the design of the study follows in 
Chapter III. The sane system is illustrated and the reference 
variables, which are used in an attempt to identify the components, are 
explained. 

Chapter IV outlines the exact method of analysis used and gives 
the preliminary results, i.e. the number of components chosen for each 
of the task variables. 

A summary of the results appears in Chapter V and a discussion 


of the results and their significance follows in Chapter VI. 
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CHAPTER II 


ANALYSIS OF INDIVIDUALIZED INSTRUCTION 


Arithmetic Instruction Using Computers 


A great deal of work has been done recently in the field of 
computer-—assisted instruction. Research has been reported from many 
universities, including the University of Alberta, Florida State Uni- 
versity, the University of Illinois, Pennsylvania State University, 
Pittsburgh University and Stanford University. 

Suppes and Morningstar (1969) have reported on the program at 
Stanford in which computer-assisted drill in arithmetic was used to 
supplement the classroom teaching of grade school arithmetic. Suppes 
and Ihrke (1969) have described in detail the results of the program and 
Suppes and Jerman (1968) provided an outline of the curriculum. While 
the results of the Stanford program have been mixed, the study has shown 
that students, especially those who are regarded as slow or deprived, do 
benefit from drill on the computer in addition to traditional instruction. 

The advantages of computer drill for the student are many. A 
drill session can be individualized so that the student begins, works, 
and finishes independent of other students. An incorrect response can 
be corrected immediately. Missed sessions do not leave the student a 
day behind the rest of the class. Of more concern for the present study, 
however, is an important advantage for the researcher. With little cost 
in time or effort, complete records including data on the response 
latencies can be kept for all drill sessions. 


Having available the response latency for each problem worked on 
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5 
by the student opens up many possible areas of research. One of these 
possibilities has been explored by Suppes and Groen (1967) who intro- 
duced five models which differentially predict response latency for the 
addition of two one-digit numbers. Latency times were then used to 
determine which of the models most accurately described the actual 
numerical operations performed by the students in solving the simple 
addition problems. Suppes (1967) and Suppes, Hyman, and Jerman (1967) 
used regression techniques to predict latencies for more complicated 
arithmetic problems. 

The present study is similar to the work done at Stanford in that 
computer-assisted drill is used to supplement classroom instruction in 
arithmetic. However, where Suppes and his associates are primarily con- 
cerned with generating general models of performance, the purpose of 
this study was to investigate the individual differences that emerge 
during the drill and to examine the utility of a technique for identify- 


ing individual differences in performance. 


Learning Curves 


The use of curves to give a pictorial representation of learning 
data is by no means a recent development. Nor is criticism of the use 
of learning curves. Most of the criticism has been aimed at the various 
types of average learning curves. 

The average learning curve, in many instances, has been shown to 
obscure individual differences. Hilgard (1938) pointed out that the 
Vincent curve procedure, which averages individual performance curves, 


may reveal the form of the learning function as learning reaches a 
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6 
criterion of mastery, but nothing is revealed about individual differ- 
ences. Hilgard discussed several methods of weighting individual curves 
which help to more accurately reveal the learning function. 

Sidman (1952) looked at a frequently used learning function, 

y=M-M apes 
If different values are taken for M and k and individual curves are con- 
structed, all will be of the same form. But if the individual curves 
are averaged, the average curve will be of a different form. Further- 
more, a number of other curves can be found which approximate the form 
of tne individual curves better than the average curve. 

Where the individuals' curves are of different forms, Hayes (1953) 
pointed out, the form of the average curve depends on the distribution 
of the individual curves. Hayes showed that if the only difference 
between individuals is in their speed, that is if the individual curves 
are of similar form but transposed horizontally, then the backward learn- 
ing curve gives a true picture of the learning function. Otherwise, 
Hayes stated, individual curves should be used rather than any type of 
average curve. 

Estes (1956) took a more analytic approach to the problem of 
average curves. He pointed out that an average curve could be derived 
from any of an infinite number of combinations of individual curves, 
and that it is, in general, not possible to deduce anything about the 
individual curves from the average curve. To show the relation between 


individual and average curves, he defined three classes of function or 


curve. 
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Class A includes those curves whose form is unmodified by aver- 
aging. Further, the parameters of the mean curve are the means of the 
corresponding parameters for the individual curves. Such functions as 
y = a+ bx, y = a log x, and y = a sin x + b cos x are in this class. 
Average learning curves are valid descriptions of individual curves for 
this class. 

In Class B are those curves for which averaging leaves the form 
unchanged but complicates the interpretation of the parameters. For 
these curves, the parameters of the average curve are functions of the 
parameters of the individual curves. Functions of the form y = log bx 

1 


and iol cretnaa 


are in this class. Average curves are useful for this 
class as well, but care must be taken in interpreting the parameters. 

Estes' Class C is made up of those curves whose form is changed 
by averaging. The function mentioned above, y=M-Me- a is an 
example. It is for this class of curves that averaging is least use- 
fu. 

It should be noted that most traditional learning curves would 
be classified as Class C functions. 

There are additional problems with using single curves to represent 
learning. A single curve suggests there is a single factor or com- 
ponent underlying learning. While this may be the case for some simple 
laboratory tasks, it is far from universally accepted that all learning 
depends on a single factor. It is possible, of course, to postulate 


more than one factor making up an average curve. Stake (1961), using a 


modified version of the Thurstone learning curve, found up to ten para- 
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8 
meters which could be investigated including the degree of curvature and 
the coordinates of the point of intersection of the initial and final 
asymptotes. The choice of the parameters to use is arbitrary and, Stake 
pointed out, could depend on the particular learning situation. 

The use of a single curve may fail to represent learning for yet 
another reason. Bakrick, Fitts, and Briggs (1957) showed that varying 
the criterion for success in a dichotomous task results in entirely 
different curves. Any learning curve has two areas of insensitivity, 
the initial area where improvement has not yet been great enough to 
register and the final asymtotic region where there is little room left 
for improvement. In the central portion where the error rate is around 
fifty per-cent the curve is most sensitive to learning. Therefore vary- 
ing criterion for success could produce curves which are relatively 
insensitive to the actual learning which is occurring. This can be the 
case either when the criterion is too difficult or when it is too easy. 
This characteristic is particularly important when two curves are to be 
compared. 

What was needed then was a method which would preserve the form 
of the individual curves while simplifying the data and which would 


provide information about the factors underlying learning. 


Component Curve Analysis 


Tucker (1958) showed that factor analytic methods can be applied 
to a non-linear functional relationship to determine its parameters. 
This led Tucker (1960) to apply the method to learning data and develop 


the procedures for component curve analysis. Instead of investigating 


6 
bose swinyiws Yo sergeb sd? gatbyLont besagtsssvat a 
fant bra fetrint sdj t0 nottseetésnt to tatoq sit to 
e#ed2 ,bne (anzdidrs vit sev oF srstemoteq oft Yo sokodd aa? 
~«rotteutte gaintesl sslyolsisq sii ‘ao basgeb biuoo 0 tmaatog 

"gay x02 gatntsol jnsestqot o4 List vem evo slgnte s to seu ofl 
gntyxev Jedd bowore (Veer) aggixd bas .239t% ,Anbeted oan veseme 


cd 


ie 


a 


qlertins o} eaivesy aesd evomododotb s ai aescove 10k mokvedia> edd 
eeatvistensent io essts ows eed sys gatnsesl yoA car tos SLE 
oat dguons. Issig need Jsy Jon ase tnsmovorgmt stedw sss tabstad ds 
#iel moot sixiil ai s1ed2 stedw cotgor visosmyes Tent off bas veaatger 
bavoms ef 9381 toT1s 93 sxarlw notixoq Iexinas offi al snemeverqel! 0% = 
“"iasv si0teted? .gainzesf o3 sviitbanea jJaom at aviun sido serso~seq YORER 7 . 
Yeviteies sis dotdw esvxus arteehs biuos or rot aotissizo gab 
of} edas> aid? .gnivtuoso at cay anteisel Isyzos sds of ovidtensent 
+¥aso ooF ek 31 noriw to tfuotitkh cor at aokxe3 bys ens natiw xodate’ dao 
od 03 918 sevinoe ows oodw Insaxogmt yixslvotixeq at otietisz;exeds ott 
+botaquo>- 
mi102 sii svtsae1q bivow dolidw bordism s esw mond bsbsen esw tadW @ 7 
biuow me bis sisb odd goityitiqnia slinweevrua foubkvibet ons %0 | 


vemirisel gutyfebau 103062 silt Juods doladene! 

betiqgqs od as. sbodasm oljylans tot si jada bom ee i ala gree ; 
8397 9me16q ait entmro39b o2 eee snot: ny ciel Bakes 

aofevsh bas sinh antaresl 03 ne eae 

gatsegizeovat Yo beotent. Gini 


either general attributes of learning or individual differences, the 
researcher, using Tucker's procedure, could now look at both phenomena 
at once. 

The classical factor analytic model is generally formulated as 
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where a is the standard score for an individual i on a test j; aye is 
the factor loading of the test j on the common factor k; Fig is the 
factor score of individual i on factor k; mf is the loading of test j 
on the unique factor; and Mee is the factor score for individual i on 
the unique factor for test j (Harman, 1968). This model postulates a 
linear relationship. The usual procedure is to solve for the common 
factor loadings and disgard the unique factors as well as those of the 
common factors which do not contribute significantly to the variance of 
the original matrix Z. 

The basic equation of component curve analysis is similar to 


equation (2.1). Using Tucker's (1966) notation, 
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where x,, is the observed score for individual i on trial j, and for 


ji 


component k, b is a coefficient dependent on the trial and ret is an 


jk 
individual parameter. The interpretation of the terms, however, is 
quite different from that in classical factor analysis. The on of 


equation (2.1) is said to be a weighted sum of the factor scores for an 


individual where the weights are the factor loadings for the variable. 
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10 
In contrast, the a4 of equation (2.2) is considered to be a weighted 
sum of reference learning curves where now the weights are the indi- 
vidual factor or component scores Yet and the reference learning curves 


are the component loadings b Component curve analysis is thus analo- 


jk’ 
gous to Fourier Analysis in that a complicated function or curve is 
broken down into a weighted sum of more simple functions or curves. An 
initially ahh eoee relationship is transformed into a linear relation- 
ship similar to that of factor analysis. There is no reason to expect, 
of course, that the component curves will be linear, or quadratic, or in 
any simple, readily identifiable form as they are in Fourier Analysis. 
What is claimed for component curve analysis is that the component curves 
will represent significant parameters in learning which might possibly 
be identified. 

The solution of equation (2.2) is similar to the principal axes 
solution of the classical factor analysis equation. In matrix form, 
equation (2.2) becomes, 

(223) eek = abeY 

where X is the n x N matrix of the scores of N people over n trials, B 
is an n x n matrix of component curves, and Y is ann x N matrix of 
component scores. (It is assumed here that n < N.) 

As in factor analysis, however, the interest is seldom in repro- 
ducing the entire input matrix. Instead of using all the terms in 


equation (2.2), an approximation is made to X using a limited number of 


components, r. Equation (2.2) becomes 
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or in matrix notation, 
Or) Xx. = B ae 
where i is an n x N matrix which is a least squares approximation to 
X employing r components. B. is now an n x r matrix, and Y- is anrxwN 
matrix. 

Equation (2.5) is solved using a technique derived by Eckart and 
Young (1936). The technique consists of dividing the original matrix 
into a product of three new matrices, 
(2.6) X = VGW 
where V is an n x n orthogonal matrix (whose columns are called the left 
principal vectors of X); W is an N x N orthogonal matrix (whose rows are 
called the right principal vectors of X); and G is an n x N matric whose 
upper left section contains the principal roots, hy hos acne nw? in the 
diagonal and which contains zeros elsewhere. The approximation matrix 
X is formed by using only the first r columns of V, the first r principal 
roots, and the first r rows of W. Equation (2.6) becomes 
(Zed) x. = he GW 
where V is an n x r matrix, G an r x r diagonal matrix, and W anr xN 
matrix. 

Tucker defined Bx and Y* two possible values for BE and Bi as 
follows 
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The value (x)= is used to scale Bx so that the simple sum of the com- 
ponent curves will be of the same order of magnitude as the weighted 
sum. This makes it possible to compare curves derived from different 
groups. Weitzman (1963) explained in detail the rationale behind the 
scaling. The value (ny? in the expression for Ye is necessary to pre- 
serve the equality of equation (2.5). The B. and Y,. of equation (295) 
are obtained from Be and Ye by rotation. The possible criteria for this 
rotation will be discussed later. 

The solution of equation (2.6) is carried out in the following 
manner. If the original matrix is post-multiplied by its transpose and 
divided by N to form the mean cross product matrix, then 


Qu 


(2.10) XX'/N=VH 
where the characteristic roots in He are the scaled (by N) squares of the 


principal roots, i os sere Ne The characteristic vector matrix V 


ike 
contains left principal vectors of equation (2.6). 
It does not matter where in the analysis the extra terms corre- 


sponding to A r SiC ba) A are dropped. Perhaps the best ap- 
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proach is to carry all of the components until the solution is complete. 
At this point, the final columns of B and the final rows of Y can be 
dropped to yield BX and Ye. If the complete V and G matrices are used, 
(2.11) B* = VH 

and Y* can be obtained from 

(2ale eeY somal 8 PKs 


If the last components are dropped from V and G immediately, 
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(2.13) ee H.. (BX) Xx. 
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The above analysis is parallel to that of the principal axis 
solution but the starting points are different. Factor analysis begins 
with a correlation matrix while component curve analysis begins with the 
cross product or variance/covariance matrix. It is this difference as 
well as the difference in the input data (scores on tests versus re- 
peated scores on trials) which accounts for the different interpretation 


of the results. 


Problems in Component Curve Analysis 

Thus far, the analysis described has been relatively straight- 
forward. Those who have used the technique do not differ markedly in 
the method of analysis described above. Ross (1964) divided the charac- 
teristic roots among B and Y, but this does not affect the actual curves 
obtained other than to scale them up or down. Yet there are many areas 
left to contention. Among the problems still unsolved are the number of 
components to keep, the significance of the data means, and the value of 
various types of rotation. 

Tucker (1966) gave two methods for deciding on the number of 
significant components. The first consists of forming a mean square 
ratio for each factor k using 

2 peat 
(2.14) (MSR). =} k (DF), / (dF), di r p 
pek+l 
where 
(2aLS) (dF), aon en + Le 2k 
(2216) (DF), = (n - k)(N - k) 


This is a ratio of each characteristic root (of XX') to the total of the 


remaining values. In other words, it is the ratio of the variance taken 
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out by component k to the variance remaining. The distribution is 
similar to an F distribution for very large samples. Tucker, however, 
gave no distribution for small samples. Weitzman (1959) used a similar 
ratio of variances. 

Tucker's second method is based on the assumption that the series 
of coefficients over trials for any valid component should form a smooth 
curve. The differences between consecutive values of the left principal 
vectors (columns of V) are squared and used as an index of the smoothness 
of each curve. Once again, the values of this first difference which 
represent meaningful factors must be chosen arbitrarily. 

Gulliksen (1959) in discussing learning curves suggested an ap- 
proach similar to Tucker's mean square ratio. He advocated looking at 
the difference between consecutive characteristic roots. If the differ- 
ence between i, and i is significant and the difference between 


k k +1 


ie pve and he 49 is insignificant, then there are k valid components. 

Weitzman (1963) suggested using the runs test. Since the first 
component will account for the maximum variance possible and approaches 
the mean curve, the remaining components will fluctuate about the zero 
line. If a component does not exhibit significant trend, it is regarded 
as representing error or noise. It and all succeeding components are 
disgarded. Siegal (1956) gave tables which can be used to determine 
significant trends. Unfortunately, the number of trials must be eight 
or greater for the runs test to have any meaning. 


A discussion of these methods follows in Chapter IV. An attempt 


is made to derive a statistical test to determine the number of com- 


vs 
| gt maktudizdetb odz ‘sake tame een te, Ot 
gravewor ,TexlouT § .zelqmsr oyzal- cro rok r prseth 4 
antimis in beau (¢2el) namssteW tee 


. | r= | | , Pie om a 
eetase sd7 ads notiqwaes ort a0 Secek Pereneen wee 4am > 
djooma s aro? biuode Insnoqa> biley yos 102 eleiys tavo ; 

Legtoatxq Jiel sid to eoulev ectacaesnod nsevied! esombset3th axl sans a « 
sesnitjooma sii io xebni oe eb boew bas beteupa axa (V te ennwtoo) | 
flo td gonsrstitb tzxtt etd to asifav ony sige: S000 
Yikisxsidis aseods od Jaum szoi>e2 

-q6 ne beseoggue eaviws gntaxeel gokeavoetb. ot feet . 

38 gattool betacovbs sH .olist sxsupe asam 2 ‘rsxigqut 03 3 
—1stitb ails HIE .e300r okveitedoex1sds evimuoeedoo sieges fe 

neaswisd Sonezstith eta baa josotitagta ei oo i* bas Fe 
-23nsnognios biiny a sts s19d2 weds ,dneakabagtont sh 3 ae 
jextt od3 somte .3e93 2nvy of] gmbeu beseeggue (C801) ae 
aerosorqqs bne ofdtezoq sonsizev mumbxsm orld x9t saheadendl , Lb wi 
oya2 oad duods sisviouli Ilikw ej3asneqmos rida me : 
bebyagez ei 3! ,baszd jnaatiingte thdid«s jon eéob 3asa6 
e76 eJnsnoqmos guatbesooue [ls Bae 31 -oeton 10 2 
enierra3sb od beeu sd ass dotdw aolded sveg” (@20t) te 

tdyte od tevm efetr3 to r19dma ons irae ta 2 

maces wt oe _ what 


= 


15 

ponents which should be retained. 

The second problem has to do with the means of the data. Ross 
(1963) showed that removing person or test means before performing a 
factor analysis produced a shift of the origin to the centroid of the 
tests or persons respectively. In component curve analysis, the first 
component closely approximates the means of the data. It is possible 
to perform a rotation so that the first curve will pass through the data 
means. This tempts one to remove the means in advance. But Ross (1964) 
showed that removing the test means in advance did not simply remove the 
first component. Instead, similar to the results in factor analysis, 
removing the means shifts the origin to the centroid of the person 
configuration while preserving the number of components. This covariance 
solution obtained by removing the trial means from the data has many 
desirable properties but some information is lost when the means are 
removed. The problem is discussed more fully in Chapter IV. 

Finally there is the question of rotations. Mathematically there 
is no difficulty. The rotated trial loadings and the rotated component 


scores are given by 


* 
(2.18) BE Bx T 


pot yx 
r 


(2.19) tee 
where T is any non-singular r x r matrix. The problem is in choosing the 
criterion to use in deriving T. The factor analysis answer of simple 
structure is not generally applicable. There is no reason to expect 
simple structure in the trial space, i.e. a trial loading on one com- 


ponent but not on another. It is conceivable that in some applications, 
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we could expect an approximation to simple structure in the person space, 
i.e. individuals loading more heavily on one curve than on another. 

Tucker (1966) used as his criterion the requirement that all of 
the component curves have non-negative entries, non-negative slopes when 
smoothed, and reach an asymptote. Ross (1964) showed that putting one 
of the components through the centroid of the person configuration 
results in a corresponding curve which is proportional to the original 
data means. 

Duncanson (1964) used the unrotated component scores as test 
scores in a factor analysis. The traditional factor analytic rotations 
were then used on the factors obtained. 

In general, the rotations employed will devend on the exact 
nature of the learning task which produced the components. Cliff (1962) 
provided a technique for rotating to various types of functional re- 

Tee onehies. Thus if there is some apriori knowledge about the com- 
ponents, a rotation can be derived which will attempt to fit the obtained 
components to the theoretical components. 

The rotations employed in the present study and the rationale for 


their use are discussed in Chapters IV an V. 
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CHAPTER III 
DESIGN OF THE STUDY 


The Arithmetic Task 

The learning task was a drill in basic arithmetic. Expressions 
of the form a + b = c were presented. In each case, one of the values 
was missing. The student was asked to supply the missing number. 

A drill session consisted of sixty problems, ten of each of the 


types shown below. 


Type I: Ey ge ep Se 
Type II: Eels ee 
Sype ,LLL a eee c 
Type IV: eee Fo c 
Type V: select whDebs = c 
Type. Vide: ge Dak c 


The problems were presented in the order listed, ten of Type I, ten of 
Type II, etc. The values in the expressions were generated randomly as 
each problem was presented. For addition, "a" and ''b'' were numbers from 
OMtoeOMand for subtraction, “b” and “c'’ ran from 0 to 9. 

The students performed this task at terminals of the IBM 1500 
Computer System at the University of Alberta. Each terminal included a 
display screen, an audio headset, and a keyboard. Although there were 
sixteen terminals available, no more than eleven students worked simul- 
taneously. This decreased the time lag between problems and insured 


that no students would have to wait if one of the terminals were in- 


operative. 
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At the first session, an audio message (AAl) was played giving 
the instructions for the task. (See Appendix A for a script of the 
audio messages.) The problems were then presented on the display screen 
(a cathode ray tube.) The numbers were approximately an inch high, six 
times the size of numbers which would normally appear on the screen. 

The larger numbers were created so that young children could recognize 
them easily. 

The student answered or solved the expression by pressing a 
number on the keyboard. If he answered correctly, two forms of rein- 
forcement were given. His answer appeared immediately in the blank 
position of the arithmetic expression and brief words of encouragement 
were fed to him through the headset. These audio messages are shown in 
AA2. If he answered incorrectly, his answer was displayed at the bottom 
of the screen superimposed with an "X''. The correct answer was then 
displayed in the blank. No audio message was given. 

A student was allowed thirty seconds to respond to a problem. If 
he did not answer in the allotted time, an audio message (AA3) reminded 
him to respond more quickly. The correct answer was then displayed in 
the blank. 

When a student completed the course, an audio message (AA4) 
directed his attention back to the screen where a summary of the number 
of problems answered correctly and the number answered incorrectly ap- 
peared. 

For a more complete description of the drill program, see 


Fitzgerald, Maguire, and Mullen (1970). 
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The students were given seven drill sessions, one per day. The 
sessions were held in the mornings of five consecutive school days and 


on the following Monday and Wednesday. 


The Attention Task 

It seems reasonable to assume that for repeated drill sessions, 
the level of attention of the student will play some role in accounting 
for the variance of the scores. Thus a task was programmed for the 
computer which would provide measures of the level of attention for stu- 
dents at different times in the course of the study. 

This attention task required the student to press the space bar 
as fast as possible whenever a number appeared on the display screen. 
A simple discrimination was required as letters appeared on the screen 
with the same frequency as numbers. The stimuli were presented one at a 
time in varying positions on the screen. The task continued until twenty 
numbers had appeared on the screen. (The number of letters presented 
during the task could vary but would be about twenty.) The instructions 
which the student received are given in the Audio Script in Appendix B. 
The attention task was given prior to the drill session on the first day. 
It then began automatically at the termination of the arithmetic drill 
on each session. A complete session, including both tasks, ran for about 
thirty minutes. Since each student could work at his own speed, some 
finished earlier than others. As they completed a session, the students 


were allowed to leave the terminal room. 
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The Subjects 

The subjects were drawn from the second grade population at the 
Forest Heights Elementary School in Edmonton. Out of a total of forty- 
four students, twenty-one were chosen to participate in the drill 
sessions (experimental group). The remainder of the students were con- 
sidered a control group and made the trip to the University on one of 
the days to work at a non-arithmetic task on the computer. 

Experimental and control groups were chosen in the following way. 
The students were ranked according to their level of achievement in 
mathematics as measured by tests taken in the school as part of an IPI 
program of math instruction. It was found that the first-ranked and 
last-ranked students were, respectively, far ahead and far behind the 
rest of the class. These two students were dropped from the study. The 
remaining students were paired, the second-ranked with the third-ranked, 
the fourth with the fifth, etc. One student was chosen randomly from 
each pair to participate in the study. The experimental group of twenty- 
one participants was then divided into two subgroups, one of ten students 
and one of eleven. Students in a subgroup worked simultaneously on the 
tasks. The subgroups worked in two consecutive periods on the computer. 
The order in which each worked and waited for the other was varied. 

While there was a great deal of variability in the levels of 
achievement of those chosen to participate in the study, all of the stu- 
dents had some previous exposure to the type of problems presented in 
the drill sessions. After an initial period of timidity and awe, the 


students had no difficulty operating the terminals. 
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A supervisor was present in the room at all times but the atmos- 
phere was relaxed. Any questions the students had were answered. No 
attempt was made to make them work faster. At the end of a session, the 
students compared their totals. 

Only one of the twenty-one students missed a session because of 
illness. Two others, however, discovered that by turning off their audio 
units they could disrupt the program (but only on their own terminals). 
This recurred often enough so that the data from these two students was 
incomplete and could not be used in the analysis. The analysis was thus 


carried out for eighteen students. 


Arithmetic Task Variables 

A complete performance recording was kept for each student through- 
out the study. The information was stored on magnetic tape and analyzed 
on the IBM 360 Computer after each session had been completed. The data 
available included a list of all the problems given, the students’ re- 
sponse to each problem, and the latency of each response. 

From these data, four dependent variables corresponding to four 
scoring methods were defined. In each case, the student was graded over 
an entire session. There were thus seven scores for each student on each 
of the four arithmetic task variables. 

The first variable (Number Correct) was simply the number of 
expressions which the student solved correctly. The score on this vari- 
able could range from zero to sixty. 

The second variable (Mean Latency) was the average of all the 


response times. Since the student was given only thirty seconds to solve 
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any single expression, the average latencies could range from zero to 
thirty. 

In addition to these two rather straightforward scoring methods, 
two methods which combined correctness with response latency were used 
to produce variables three and four. In each case answers were weighted 
with the response latencies. 

The third variable (Linear Score) incorporated a linear weighting 
scheme. If the student solved an expression correctly, his score was 
given by 
Var 1) S. = 10 - t/3 


where t is the response latency in seconds. For an incorrect answer, the 


linear score was given by 
Gr 2) Ns == 973: 
L 
The student's score was thus lowered by increased response latency regard- 
less of whether or not he solved the expression correctly. 

The fourth variable (Quadratic Score) was based on a quadratic 
weighting system. For a correct answer, the quadratic score was given by 
(3.3) Sq = (t-30)7/90 
and for an incorrect answer by 
(3.4) Sq = (t-30)7/90 - 10 
where again t is the response latency in seconds. 

For both variables, the theoretical range of values was from minus 
six hundred to plus six hundred. With both the linear and quadratic 


methods, the faster a student responded, the higher his score. The differ- 


ence between the two scoring systems is that the quadratic method weights 
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24 
the response latencies more heavily than does the linear method. The 
quadratic scores were, in general, lower than the linear scores. Figure 
3-1 gives a graphical comparison of the two methods. 

Each of the four arithmetic task variables was the basis of a 
component curve analysis. The scores on each arithmetic task variable 
could be broken down into scores on each of the components found to 
underlie the original scores. Thus these four dependent variables could 
be considered compound variables in that they might yield more than one 
set of scores. 

Four different methods of scoring were used so that the results 
could be compared to determine which scores most efficiently described 
what had taken place. It would be predicted that the latter two methods 
of scoring would yield more information, i.e. more component curves, 
than the first two. If this were the case, then it would be of interest 
to know how the additional information relates to the reference vari- 


ables. 


Attention Task Variables 

The attention task was included in the study because level of 
attention may be a significant factor in performance on arithmetic drill. 
By having the students perform the attention task each time they per- 
formed the arithmetic task, it was hoped that a dynamic measure of the 
level of attention would be obtained. 

Grim, Kohlberg, and White (1968) measured attention from reaction 
times on a similar task. They used mean latency, the standard deviation 


of the latencies, and the difference between the means of the initial 
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25 
five latencies and the last five. They found these measures to be valid 
indications of the level of attention for young children. Four variables 
were defined in this study for the attention task. The purpose once more 
was to compare the results of each and to determine which variable most 
efficiently measured not just the level of attention but that part of 
attention which was related to the student's performance on the arithmetic 
drill. (These variables too, should be considered compound variables be- 
cause each yields one or more sets of component curves.) 

The first attention task variable (Mean Latency) was the average 
of the response latencies for all twenty numbers which appeared on the 
screen. The student was given up to twenty seconds to respond. Thus 
the range of possible values was from zero to twenty. 

The second variable (Difference) was the mean of the last ten 
response latencies minus the mean of the first ten. The difference could 
be from minus twenty to plus twenty. 

The third variable (Median Latency) was the median response 
latency. The median ranged from zero to twenty. 

The fourth variable (Standard Deviation) was the standard devi- 
ation of the response latencies. It's value varied from zero to ten. 

(Students usually responded no more than a few times to letters. 
When they did, an audio message was given repeating the initial in- 


structions. There seemed no reason to involve the incorrect responses 


in the scoring.) 


Reference Variables 


Once all of the variables for the arithmetic and attention tasks 


es 
bklav 9602 sonvenoe sears bovsl yo -ovit geal 
voléatrev woI .asrbi{ids gavoy 10% nolagesze to peodnase: 
@toni 990 seoqivq oil .jan3 solinsi3s si3 yo? ybutaa t 5 
taom sidolrev tlotdw smtmreaseb o3 bas dose to esluaatsdd 2 wane a 
Ro d2sq tari) Jud muliasttea lo Level a Sevt Jon borwasem efsaehonRee . ? 
okzemdaiie of3 no sonsmiotieq 2'Inebute oft a bosefex asw doldw nokiausaa 
-ed geldatssy buuogmen baxebisaos sd bluoie ,oot asldsixev aeoriT) hbbab 
(,29viuD dnaanoqzos io eis sion to eno eblety dee saume 


egsreve od eaw (yone2a1 masM) sidsixav desi notinsi3s Jeri edt Ge 
; 7 


ed3 no baraeqge dafdw etadmun yiaaws Iis toi estonssal senogaert ot? to 
aut? .booqes: o% ebnoose yinsw? of qu asvis eaw-dnobude sat . A399798 7 
.YIn9wI 03 o1es most egw estlev oidisacq to es 

foi ‘Jeet ai3 lo assm odd eew (somsietitd) sldatiev bnossegit 
biuos sodexstith off ned sext} sid 20 neem edt suntan esionajel sempqest 
| | -““io9ws aulg 02 yjnswd eusim word ad 
senoges: msibsm sd3 asw (yonsisd optbeM) sidatray brid? off 

. .vJaewd of or88 mor) beara netbom oAT 

~tveb brebssie sii eew (notistvad bisbnaze2) oldatzev d3ayo2 
“793 62 O78 mor? bolasv sulsy ati -estonegsl, icaiaaat lon 


-@%99391 oF nemts wot 6 edt sx0m on bsbuoqzet stance ‘easbuae) 
_ 


“at Ialginl oa gnliseqst evita saw 2gseeom obbiid, an. 46 
eeenoges? PeXtoont sdy svlovat o3 ovens: on  banase 3508 0 


26 
have been analyzed, there will be eight groups of component scores. By 
investigating the correlations between sets of scores, the relationships 
between the components of the various task variables can be identified. 
For instance, the scores on the second component derived from the Linear 
Score variable might be highly correlated with the scores on the first 
component derived from the Number Correct variable. While this infor- 
mation is valuable, it does not really explain much about the identity 
of either component. On the other hand, if a set of component scores is 
correlated with reference variables such as the students’ IQ's, then 
there will be some basis for identifying that component. The function 
of the reference variables listed below is to aid in identifying the 
components which are found to underlie the learning task. 

Where possible, scores on the reference variables were obtained 
for the entire population of second graders. Some of the measures, such 
as IQ, were taken from the school records. Other scores were taken from 
tests given the students before, during, and after the twelve day period 
in which they participated in the drill sessions. 

In a few cases, complete sets of scores on a reference variable 
were not available for a student who participated in the drill sessions. 
Rather than drop the student from the analysis or correlate with missing 
data, the score was derived either by using regression techniques or 
merely by giving the student the median score of the rest of the class on 
that variable. The scores for all of the students on the reference vari- 
ables are given in Appendix C. Where a score was derived, the method 


used is indicated. 
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Ability in Arithmetic 

A measure of the student's initial ability to solve the type of 
problems given during the drill was desired. Thus a pre-test made up 
of expressions like those to be presented on the computer was given to 
the students in their classroom a few days before they began the drill. 
The test was divided into sections, each section containing one of the 
six types of expressions listed earlier. There was a time limit for 
each section. The score for this variable was the total number of 
expressions solved correctly in all of the sections. The test appears 
in Appendix D. This variable, RV1, is said Cobre nesene ability in 


arithmetic. 


Reflection-Impulsivity 


Since three of the scoring systems for the arithmetic task take 
into account the response latency, the scores could reflect in part a 
predisposition on the part of the student to give answers rapidly or 
conversely to answer only after careful consideration. Many studies have 
reported a reflection-impulsivity variable where reflection implies long 
response latencies and low error rates, and impulsivity implies just the 
opposite, short response latencies and high error rates. Three measures 
of this variable were included. 

The students were given The Matching Familiar Figures Test during 
one of the periods when they were waiting to get onto the computer. 
Kagan (1967) found this test to be the most sensitive for measuring 
reflection-impulsivity. The test consists of twelve sets of pictures. 


Each set contains a standard and six similar pictures. The subject was 
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28 
asked to select the picture in the latter group which was identical to 
the standard. The response time for his initial selection was recorded. 
If a selection was incorrect, the student was given additional chances 
until he picked the correct picture or until he made six mistakes. 

The average response time for the selections was RV2. The total 
number of errors over the twelve items gave a second measure, RV3. In 
addition, a method for selecting pure groups of impulsives and reflexives 
was employed, (Kagan, 1965). Those who scored above the median on 
latency and below the median on errors were classified as reflexives. 
Those who score below the median on response time and above the median 
on errors were classified as impulsives. This procedure was followed, 
based on the entire population of second graders. A value of one was 
assigned to pure reflexive students, a value of three to pure impulsive 
students, and a value of two to the others. This variable, RV4, is 
called the Reflection-Impulsivity Index. 

It is likely that arithmetic ability and style of response affect 
the student's performance on the drill. But there are other variables 
which produce individual differences in general performance within a 
group of students. It is not expected that they will be as important as 
arithmetic ability in identifying the components of this task but it 
seems reasonable that they might be relevant. Thus the following four 


variables were included in the analysis. 


Vocabulary Score 


The students were given the Gates-MacGinitie Reading Test (Primary 


B, Form 1) prior to the first drill session. The test is divided into 
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29 
two sections. The first is a vocabulary section in which a picture is 
shown and four words are given. The student is required to select the 
word which describes the picture. There are forty-eight items in this 


section. The student's score on this vocabulary section was called RV5. 


Verbal Comprehension 


The second section, comprehension, gives a brief paragraph and 
four pictures. The student selects the picture described by the paragraph. 
There are thirty-four items. The score on this comprehension section was 


RV6. 


intelligence 


The students had been given the Detroit Beginner's IQ Test earlier 
in the year. Their scores on this test were taken from the school records 


fOr RV Is 


Age 


The student's age in months was used as RV8. 


Short Term Memory for Digits 


There is reason to believe that the student's performance on 
certain short-term memory tasks may be correlated with his ability in 
mathematics. Thus a reference variable was included which can be thought 
to measure a more basic ability than is measured by the first reference 
variable, ability in arithmetic. 

A short digit span task was given to the students during the time 


of the study. A list of numbers was played to the student on a tape 
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30 
recorder. He could hear the list through only one ear. The student 
was asked to repeat the list. The task consisted of one span each of 
five, six, seven, and eight numbers for each ear. The lists were given 
alternately in the left and right ear. 

Since few of the students could repeat lists correctly beyond the 
five-digit level, a system of scoring was used which recognized partial 
answers. For a span of length k, one point was given for each correct 
number in the proper position. The numbers not in the correct position 
were then scanned and one point was given for each pair of numbers in 
correct sequence. The total points given was then divided by k to yield 
a score between zero and one. The value of this variable, RV8, for a 
student was the sum of his scores on all eight of the spans. The lists 
used and an example of the scoring system can be found in Appendix E. 

It is unlikely that these nine reference variables encompass all 
of the relevant variables, but it is expected that the components 
extracted from the arithmetic task variables will correlate with some of 


them. A list of the reference variables is given in Table 3-l. 


Arithmetic Post-test 

On the day following the last drill Peceron en arithmetic post- 
test was given to the entire class. The test was identical to the 
arithmetic pre-test except that a seventh section containing all six 
types of expression was added. The score on this test was used with the 
pre-test scores in an analysis of covariance to determine whether or not 


the drill sessions produced learning. The test is included in Appendix D. 
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TABLE 3-1 


REFERENCE VARIABLES 


Arithmetic Pre-Test 

Average Response Time on M.F.F.T. 
Total Errors on M.F.F.T. 
Reflection-Impulsivity Index 
Vocabulary Score on G.M.R.T. 
Comprehension Score on G.M.R.T. 
IQ (Detroit Beginners) 

Age (in months) | 


Digit Span Score 
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CHAPTER IV 
METHOD OF ANALYSIS 


Before a component curve analysis was performed on the data from 
the arithmetic drill sessions, a simple test was made to determine if 
indeed the drill sessions produced learning. This test is described in 
the first section below. It was decided that if there was evidence of 
learning, each of the eight task variables described in Chapter III would 
be analyzed using component curve analysis and the number of significant 
components for each variable determined. The procedure for determining 
the number of components is outlined in the second section. An example 
using one of the arithmetic variables appears in the next section. At 
this point in the analysis a decision had to be made about the signifi- 
cance of data means. Should the trial means be retained in the data or 
removed? A method for investigating the effect of the data means is 
given in the fourth section. Finally, an attempt was made to identify 
the components utilizing the reference variables and suitable rotations. 


The procedures that were followed are discussed in the last section. 


Analysis of Covariance 


One of the basic assumptions underlying the technique of component 
curve analysis is that the data to be analyzed represents some type of 
learning. An analysis of covariance was performed using the students’ 
scores on the arithmetic pre-test and post-test to determine whether or 
not a significant degree of learning took place within the experimental 


group. A one way analysis of covariance was used rather than an analysis 
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of variance because adjusting the group means on the dependent variable 
(score on the arithmetic post-test) through the use of a concomitant 
variable (scores on the arithmetic pre-test) resulted in a more precise 
test. See Cox (1958) for a more complete discussion of the rationale 
for the use of an analysis of covariance. 

The hypothesis, of course, was that the scores on the arithmetic 
post-test for the experimental group, those students who participated in 
the computer-assisted drill, would be significantly greater than the 
scores for the control group, those students in the class who did not 
participate in the drill sessions. Eighteen sets of pre-test and post- 
test scores were obtained for the drill group and, by coincidence, the 
same number were obtained for the control group. Thus the analysis was 


performed with equal n's. 


Determining the Number of Components 


A great deal of preliminary work was done in an attempt to derive 
a statistical test for determining the number of components. Much of 
that work is still in progress. For that reason, only the results which 
are directly applicable to this study are discussed. 

There are two approaches to the number of components problem. The 
first involves looking at the characteristic roots. Mean square ratios 
can be formed and compared with the f statistic distributions or the 
differences between succeeding roots can be compared. The second ap- 
proach involves looking at the characteristic vectors. First differences 


can be computed to test for smoothness or the runs test can be used to 


test for significant trend. 
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For the type of data in the present study, the second approach 
is of little use. With a small number of trials, the first difference 
for a steep, monotonically increasing curve can be larger than the first 
difference for an obviously random curve. This would lead to rejection 
of the significant curve or retention of the insignificant one. (For a 
large number of trials, this possibility is less likely, and the first 
difference appears to be an adequate measure of "'smoothness.") The runs 
test, as mentioned earlier, is not appropriate for less than eight trials. 

The significance of tests on the characteristic vectors depends on 
the number of trials. For tests on the characteristic roots, a more 
crucial factor is the number of people. There is no distribution avail- 
able for mean square ratios for small numbers of people. One reasonable 
procedure is to look at the ratios and pick out the k ratios that appear 
to be larger than the rest. The k roots corresponding to these ratios 
are used in the generation of k components. It would obviously be de- 
sirable to find another method which could be used to verify the results 
obtained from the mean square ratios. 

A second poseabal eye is that succeeding characteristic roots be 
investigated using the jackknife technique as described by Mosteller and 
Tukey (1968). With component curve analysis, the first component approxi- 
mates the data means and the first characteristic root is usually many 
orders of magnitude larger than the succeeding roots. The remaining 


roots will usually be of the same order of magnitude. Thus, a plot of 


* 
This procedure was suggested by Dr. T. Maguire. 
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the succeeding roots will show a large gap between the first and second 
roots and small gaps'from then on. The usual procedure has been to 
"eyeball" the gaps to decide which roots after the first are significant. 
The jackknife technique provides a more accurate measure for looking at 
the gaps. 

The jackknife technique is useful in situations where the sampiing 
distribution of a statistic is unknown. In effect, the technique gives a 
confidence interval for a statistic by systematically excluding one person 
at a time from the calculation. For characteristic roots the technique 
is as follows. A root (say the first) is obtained from the mean cross 
product matrix XX'/N. This is the square of the root of the N person 
data matrix X. This "real" value is designated by \} ALL. The first 
person is then excluded from the data matrix and a new cross product 
matrix is formed from the N - 1 person data matrix. The first root is 
computed from the new cross product matrix. The value of this new root 


is denoted by A indicating that the first person has been omitted 


i ee 


from the calculation. The first pseudo-value is defined as 
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In general, if the ith person has been omitted from the calcu- 
lation, the ith pseudo-value is 
(4.1) Ned =N d ALL - (N - 1) d O55: 

An estimate of the true value of the characteristic root, called 


the best single result, is the mean of the pseudo-values, 
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An estimate of the variance is 
(4.3) s?*, = s2/n 
where 
Dy Be Lee 2 
C054) 94S" SSDPERING2«— a/ NOD Wye) ey 7 (ned )t 


The confidence interval for a characteristic root is then given by 
CAPD) R ee a J ila _ 79) Sy. 

In actual practice, all n values of X ALL (the n real characteristic 
roots) are computed from the mean cross product matrix at one time. 
Similarly, as each person, i, is dropped from the data matrix, n values of 
RH) are computed at once and n values for (4) are found (corresponding 
to the n characteristic roots). After each of N persons has been ex- 
cluded from the computation, the pseudo-values are used to find the n 
best single results and the corresponding n confidence intervals. 

It is tempting to try and find a rigid statistical rule which 
could be applied to the confidence intervals to determine the number of 
significant roots (and thus the number of significant components). Un- 
fortunately, this is not possible. The confidence intervals are set up 
using the t statistic but the distribution of pseudo-values for any root 
is at best, skewed to the left and is at times completely unrecognizable. 
The intervals really have little statistical significance. Further, if 
more than one comparison is to be made, then the simple t statistic should 
not be used. 

While the intervals cannot be used in a statistical sense, they 


can be employed to indicate where there are gaps between succeeding roots. 


For this study, the following procedure was used. Starting with the 
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first root, the best single result was compared with the confidence 
interval of the succeeding root. If the best single result was con- 
tained in the interval, then the two roots were said to be of the same 
relative importance. If one was retained, both were retained. The 
process was carried out until all of the roots had been arranged into 
groups. These groupings were then used together with the mean square 
ratios to determine the number of components. 

The scores on each component (the rows of the Y matrix) were used 
to attempt identification of the components. Significant correlations 
between a set of scores on a component and the set of scores on a refer- 
ence variable indicate a relationship between the component and the 
reference variable. As an additional check on the choice of the number 
of components, the highest order component of those discarded was tested 
to see if there were any significant correlations with any of the refer- 
ence variables. If there were significant correlations, that component 
and any others which had been grouped with it were retained. 

After the number of components had been fixed, a measure of the 
extent of the factoring was computed. If r components are retained, the 
approximation matrix is given by 


(4.6) X.. = B. tp 


a 


as mentioned earlier. xX. is a least squares approximation to the data 


matrix X for r components. The error or residual matrix is given by 


aA 


(4.7) Koes > Xe 


This error matrix contains the amounts by which the scores computed from 


r components differ from the original scores. The entries in the error 


ae 
sbasb tens adtditwbeanqaos enw italics 
a03 maw tivess elgate teed ofa iI 190% sat 
ingot Sead 02 bise sYaw @200% ows edd ced , Levis 
$dT, .bunteiex otsw dod -benisje: eaw eno TI wa: 
o3n) bagnaxie aad bad atoor edt to -% iigau duo t | | IBS) 
@ieupa miem oily diiw r6lj9god bse nadi stew ail’ 
-etasnoqmos jo rodaua of? emtonedeb oF 
beev s2aw (xbxaem Y sd Yo ewor add) tnsnoqmos does a0 eer008 oat” - 
acotislerzos Jnaztitagie .e%meneqmoz aii io sotzsoLisinebt. Jqmagaesed 
=teler » mo #6to0o2 to toe sil bis Jasnogmos & m0 aoto ito Joa & 


_ 


ah dete 
add bas saamvqmos eft peewtsd qirianoLislex 6 sveothat atdatimnwada | 7 
weduun of3 To sotodo si2 no. sparta ignotathbe OB GA 4 a | 


besee2 ssw bebyasoeth asodd io tnemogmo2 1shyx0 deengid: ‘ia asoesoqne te 

17 
~telet ads to me tatw eacktalerz0o jeep titngke | ‘yaa anion 7 
denogmo> Jas3 pano2ielexra> jasDLitaghe otew S199. a1 ss ; Idetrov Oe ; 


ca ape 


‘benisies s19w af idtw bequorg cued bad ‘fordw seo yan ae 
982 io eniensa & »bextt need bs) eananoqmon to xedmen sia cael A 
et ,benteasss ova e2nenoqmos + iI «-batuquoa esw satxosos? ‘ 


- 


ud asvig eb xtrten 


ae 
siab es 93 mokiemtxoxggs eoteups Javel & at # Jade 
“ud mevig et xttiam [eubbeot 10 Torre sit Jet. tn9 ae ’ ae am 


mort beguqman wenens..ads, dohay: 4.930 
10733 vil ml eelains = atone Lontate 


38 


matrix derived from the data in this study were divided by the original 


scores and the row means computed to give each person's percentage error. 


The mean of these error percentages was used as an index of the extent 


of the factoring. 


The procedure discussed in this section is summarized below. The 


appropriate equation for each step in the analysis is indicated. The 


analysis begins with the n x N data matrix N. 


1) 


2) 


3) 


4) 


5) 


6) 


7) 
8) 


9) 


10) 


Eo) 


Form the n x n mean cross product matrix, XX'/N. 


Find the characteristic roots and vectors of the 
mean cross product matrix. (2.10) 


Compute the mean square ratio for each of the n 
Characteristic arOOLSeame(2..L4)meml > ee (2016) 


One by one, drop individuals from the original 
matrix and re-form the mean cross product matrix. 
Find the characteristic roots and compute the 
pseudo-values. (4.1) 


Form confidence intervals for each of the n roots 
and use the intervals to group the roots. (4.2), 
COB FT C4 EL IFS (HS5) 


Use the mean square ratios and the groupings to 
determine the number of components, r. 


Compute the loadings of trials on components. (2.11) 
Compute the component scores. (2.12) 


Test the (r + 1) st set of component scores for 
significant correlations with the reference vari- 
ables. If necessary, increase the number of 
components retained. 


Form the approximation matrix using r components. 
(4.6) 


Compute the residual matrix, the individual error 
percentages, and the overall mean error percentage. 


(4.7) 
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39 
The analysis described above was carried out for each of four 
arithmetic task variables and, to a limited extent, for the four 
attention task variables. The analysis is presented in detail in this 
paper for the first arithmetic variable, Number Correct, and the results 


for the other task variables are summarized. 


Preliminary Results 


The data matrix for the first arithmetic task variable is given 
in Table 4-1. The entries are the number of problems solved correctly 
by each person on each trial. The mean cross product matrix, its roots 
and vectors, and the mean square ratios are given in Table 4-2. A check 
of the mean square ratios showed only one ratio which was obviously 
larger than the rest. Comparing the ratios to an F (a = .5) distribution, 
however, indicated that the second value was also significant. 

The results of the jackknife procedure are shown in Figure 4-1. 


The confidence levels are based on t for seventeen degrees of freedom. 


DU) 
The first pseudo-value (not shown on the graph) was much greater than any 
of the succeeding values. There were significant gaps between the second 
and third pseudo-values and between the fifth and sixth pseudo-values. 
The roots were grouped as indicated. The decision, based on these group- 
ings, was to retain either one, two, five, or seven components. It 
should be noted that the first two roots were relatively stable in that 
the best single result for each was close to the actual value. 

The trial loadings and the component scores were then computed. 


The two matrices are given in Table 4-3. The first three rows of Y 


(columns of the Y' matrix shown in Table 4-3) were compared with the 
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TABLE 4-1 


ORIGINAL SCORE MATRIX 
ye 


ARITHMETIC TASK VARIABLE ONE - NUMBER CORRECT 


TRIAL 
PERSON al 2 3 4 3) 6 
cE Boe) 42.0 36.0 45.0 45.0 47 
2 42.0 48.0 25.0 Seige, 57.0 56 
3 21.0 27.0 56.0 58.0 60.0 e)) 
4 36.0 34.0 33.0 34.0 42.0 Sy) 
> 39.0 47.0 51.0 a/.0 Sm oi 
6 42.0 50.0 49.0 ayeyae) 48.0 49 
7 42.0 50.0 Syne) 47.0 50.0 52 
8 57.0 60.0 StigW) 59.0 57.0 29 
9 48.0 55.0 56.0 58.0 ajar) 58 
10 42.0 5220 Spb el@) 49.0 56.0 58 
das 50.0 48.0 58.0 Sy a) 59.0 55 
12 54.0 Soe) Dial) pala0 53.0 56 
3. 41.0 50.0 Do60 50.0 49.0 45 
14 45.0 38.0 51:0 53-0. 49.0 54 
Lo 45.0 5750 56.0 37.0 60.0 54 
16 53.0 53.0 59.0 31.0 59.0 i, 
a7, Do s0 56.0 D570 PEA 5920 56 
18 36.0 41.0 42.0 sh) 0) 45.0 44 
TRIAL 
MEANS edo: 49.5 51.6 Whois) De EL oz 
STD. DEV. VAS? ge) hed 6.8 Bote 


Nee EEE 


Swe we eS S&S se of fo 2S. Cc fS © eC ff S&S & f&| & 


wo 


lo 


0.3¢ 


0.82 
O.te 
0.%2 
0,88 
0.82 
0.82 
0.82 
6,82 
0,2 
0.2 


Qed. 


0.82 
0.a2 
Onk2 
0.08 
0,48 


See 


0.88 | 
0.22 O.22 0,88 
O.82 O08 Of (ONE 
Ose O86 Onde  - OnGE 
ONE 012 0.0 
0.22 0.2 ‘0.028 
O.Th  O.t2 0.08 
0.02 0,82 9.08. 
O82, Ode d.2e 
0.82 ON 0S 
MONE > OBE * DeBR 
O.0e* “ oste, /oueers 
0.02 0.22 06.02 
OFZ, Ofe — OyBE 
Ove 0.62 Or ¥e’ 
O.i2 Oee Oke 
Q.ye O18 . Oye . 
O.2€ O88 ON Lae 


.d, f2- 


AV 


CHARACTERISTIC ROOTS 


ARITHMETIC TASK VARIABLE ONE -— NUMBER CORRECT 


BEST SINGLE STANDARD INTERVAL 
RESULT DEVIATION eet LO 
18458 .6 992.9 V6363 055 eT 522059367. 
1950 One 620 = ds seo2, 1 
Jah rig 2n4 5 he sell. 8 
hcg 2.4 22 les hi, GMa 
13e3 5.2 143 5 de < 29.4 
S ers 28 Os he sve 7.9 
6 1.9 DE Om= ho < 1326 
COMPONENTS 
Group 1 1 
Group 2: 2 
Groupes: SS samehomee) 
Group 4 a5 7 
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TABLE 4-2 


CHARACTERISTIC VALUES AND VECTORS 
ARITHMETIC TASK VARIABLE ONE - NUMBER CORRECT 


MEAN CROSS PRODUCT MATRIX 


XX'/N 
13 2 3 4 $) 6 d 
th ZalWOnk ey 2378 23/6 2433 2427 2408 
2 2277 2496 O93) 2596 2656 2650 2629 
3 2378 2593 2716 py Lib 2 Hid. Sheds 2720 
4 2376 2596 2012 2726 2776 2774 ZI D2 
2 2433 2656 Pe A? 2776 2846 2031, 2815 
6 2427 2650 2767 2774 2657 2838 2809 
7 2408 2629 2750 124] 32. 2815 2809 2d 93 


CHARACTERISTIC ROOTS 


CHARACTERISTIC D:. i. Ds. MEAN SQUARE 
Se ROOT NUM. DEN. RATIO 
dh 18462.027 24 LOZ 1245.917, 
Z AUS S| Ze 80 dn 2 
3 i na ery) 20 60 PDO 
4 ee 7 18 42 1.418 
5 ot) 16 26 ds lars 
6 4,874 14 Le 1.044 
7 4.003 ib 0 0.0 


x 
Significant for F.g5 


CHARACTERISTIC VECTORS 


V 
dE Z 3 4 5 6 7 
u 0.336 0.781 -0.278 0.334 -0.117 Ui2oo 07093 
44 0.367 0.282 0.700 -0.503 0.027 O:2,0 1 Ua203 
3} 0.383 0.049 =0.3/0 -0.330 -0.306 -0.680 -0.223 
4 0.384 -0.385 0.206 0.249 -0.682 On2 b -0.1/9 
5 (We 58) -0.055 0.064 0.089 07590 Ue 26 -0.716 
6 Ono 2 -0.228 0.150 0.556 Oe arAS) -0.422 0.455 
7 0.389 -0.324 -0.476 -0.384 0.214 0.418 0.386 
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43 
scores on the reference variables. The correlations are given in Table 
4-4, 

With an N of 18, a correlation of approximately .466 is necessary 
for the .05 level of significance. The second set of component scores 
had a high (but not significant) correlation with the digit span scores. 
Together with the results of the jackknife and the mean square ratios, 
this seemed to indicate that there were two meaningful components. 

The first two component curves are graphed in Figure 4-2. The 
approximation matrix using two components is given in Table 4-5 and the 
residual matrix appears in Table 4-6. The error percentages and the 


mean percentage error are given below. 


Person it 2 3 4 5 6 7 
10.43 1387 1.80 By 248) 1.89 4.09 a.47 
8 9 10 mi 12 NS} 14 15 16 
PLS Loe 2 5.05 4.20 2.46 5.49 7.19 Oras Shs: 
17 18 Mean 
pie 8243 3.93 


The mean error was less than four percent. Thus it appeared that the 
scores could be very well reproduced using only two components. 

The same procedure was used for the remaining three arithmetic 
task variables. The original data matrices and the results are given in 
Appendix F. A summary of the number of components for each task variable 
appears in Table 4-7. 

With the attention task variables, the main concern was not to 
discover and identify all of the significant components but to find 


components which related to those found for the arithmetic task variables. 
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TABLE 4-3 


LOADINGS AND SCORES 


ARITHMETIC TASK VARIABLE ONE - NUMBER CORRECT 


TRIAL LOADINGS 
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B 
COMPONENT 
TRIAL i 2 3 4 5 6 i! 
ui 45.675 Sigal =1 5010 Va dE) ho JO) 0.566 Ont 
2, 49.857 Pe2 13 Eo spay) =i Oyo 0.084 0.025 0.407 
| By Nei) Ove -1.346 =e O90 O30 Sl 10d -0.446 
4 Doe hee = lel og 0.749 0.828 =p) Ost) 0.710 Ono / 
5 D2. 303 -0.249 O2'35 0-295 1.685 OF279 -1.432 
6 Delocaly = 0on 0.547 Miexei dul 0.854 0) a4 0.910 
fi DZeO21 -1.465 ~1.734 ahs AIRS) 0.655 0.923 0.772 
COMPONENT SCORES 
Wey 
COMPONENT 
PERSON il Z 5 4 5) 6 7 
i 0.786 -0.482 2.740 1. 886 0.235 -0.458 -1.048 
2 1.030 -leo7o -0.449 0.032 0.331 -0.644 =1.024 
3 Te UPAR, 1200 OF LZZ OEE 0.020 aU O22 L 
4 0.698 O. 912 0.060 1.006 1.418 ahead -1.408 
5 1.006 ce PSO R) = OO 0.347 -0.347 0.238 1.208 
6 O95) -0.424 0.882 aUz302 ley aay 0.901 0.319 
7 0.938 0.462 i, 039 = .057 0.140 cera Aol) -0.188 
8 i Ge Ee a 1.433 0.631 OriiZ -0.984 0.434 1093 
¢) 1.084 -0.441 0.163 -0.364 -0.572 Or2o9 1.342 
LO Lz -0.894 0.191 -0.547 2.246 —0.326 Le oo2 
11 Ihe OWS) -0.322 -1.648 0.228 -0.243 0.526 ah ee AO) 
12 1.045 E707 =Oesi2 OF 339 Soe. -1.409 0.849 
NS) 0.947 0.084 -0.081 =2.102 coil Bie Kst -0'.968 id ails) 
14 0.948 =O./2/ -1.747 2e230 =15066 -0.618 =Q2 022, 
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TABLE 4-4 
CORRELATIONS 


ARITHMETIC TASK VARIABLE ONE - NUMBER CORRECT 


COMPONENT 

REFERENCE 

VARIABLES FIRST SECOND THIRD 
RV1 652% 335 ~.182 
RV2 278 304 ~.062 
RV3 ~.230 ~.205 =F 103 
RV4 ~.098 - 288 - 308 
RV5 340 nes BGG 
RV6 640% iw B58 
RV7 467% .070 “286 
RV8 .095 .060 ~.025 
RV9 | 462 459 .007 


*Significant at .05 level 
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FACTOR LOADINGS 
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TABLE 4-5 


APPROXIMATION MATRIX USING TWO COMPONENTS 
! 
X» 


ARITHMETIC TASK VARIABLE ONE - NUMBER CORRECT 


TRIAL 
af 2 s) 4 ) 
34.2 38.6 40.8 41.8 42.0 
42.2 49.6 Dons 56.1 DO 
55.7 Mel 58.9 56.6 BDAY) 
Steal 36.0 Slo 34.8 3/20 
38.1 47.3 eRe) Domo 54.2 
42.1 Th al 49.6 EO) DL-0 
44.5 47.4 49.0 48.1 49.9 
56.7 DOr D962 Ate) Se) 
47.9 Send Does Eh) OPS!) 
43.5 49.8 D310 54.8 Bnet) 
48.0 ree sey) 56.6 57.4 
Sheed 54.3 54.8 DiS DIG 
43.5 47.3 49.3 49.2 BOOS) 
40.7 46.3 49.2 Si Ony/ DUG 7 
47.4 sual 56.0 Died D7. 
Boel 55.4 Beit! 54.8 Ss 
D202 BIS SHS) 56.5 58.6 
OO a, 40.5 G22. 42.8 43.6 
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TABLE 4-6 
RESIDUAL MATRIX AFTER TWO COMPONENTS 
(X-X,) : 
ARITHMETIC TASK VARIABLE ONE - NUMBER CORRECT 


TRIAL 
PERSON i 2 3 4 5 6 7 
1 SP cys 3.4 -4.8 pve 3.0 4.7 =8:2 
2 One =1 26 ilese = die Los -0.2 -0.4 
5) Les Hs 7 Hs) 1.4 0.3 0.3 0.3 
4 0.9 =2.0 =3.95 -0.8 5.0 0.8 His) 
5 0.9 -0.3 -O59 of ete Led 0.6 
6 =Q. 1 he) -0.6 a) =) =2ao aah sel 
7 Ze) -6 2.0 Al shh 0.1 2.0 Sais 
8 023 1.8 ke A Zing mono 0.3 -0.6 
og Oc1 1.5 =iBie 8) 0.7 209 =O.1 ed 
LO Ss) oie =2..0 —9.8 Le3 Zoi Mace) 
aH PAY) ee Eyed 0.4 i. 6 me cell 
12 ORS) ade ed 262 OE) we! the? = OT 
13 pass Zed Ded, 0.8 Whos) 85.5) sal 
14 4.3 -8.3 tle! es) ee 2S Al dl 
15 -2.4 oeg =O'50 = Ole 2.4 -4.0 0.2 
16 =Q.1 -2.4 233 6G 1.4 0.3 Ziel. 
17 0.8 0.4 =A 35) 0.5 0.4 SS oal Ze 
18 Oey 0.5 -0.5 ie 1.4 0.4 220 
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The decisions as to the number of components to retain for the attention 
task variables were therefore much simpler than the decisions for the 
arithmetic variables. The components corresponding to the largest roots 
were checked for significant correlations with the arithmetic components. 
The jackknife groupings were then followed in selecting the number of 
components to retain, i.e. all components in a group would be retained 
if any were related to the Arithmetic Task components. The data matrices 


and the results of all calculations are given in Appendix G. 


The Data Means 

For each of the task variables, the first component curve approxi- 
mated a curve through the data means. In fact, an analysis would show 
that in each case the first component curve was a linear function of a 
curve through the means. Thus there exist orthogonal transformations 
which would put the first component curves through the data means. Ross 
(1964) showed that putting the first component through the centroid of 
the person scores would result in the first component curve being pro- 
portional to the data means. 

A rotation which accomplishes this was derived for each of the 
arithmetic task variables. The rotated component scores were compared 
to the reference variables to see if the rotation had made the components 
(essentially the components after the first) easier to identify. 

Since the first component curve approximated the data means, it 
might be argued that the first component is superfluous. That is, since 
it represented merely an arbitrary scale value set by the researchers, it 


should not be considered as a component in the same sense as the second 
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TABLE 4-7 


TASK VARIABLES 


SNS a 


Arithmetic Task 
1. Number Correct (NC):Two Components 
2. Mean Latency (ML) :Two Components 
3. Linear Score (LS):Three Components 


4. Quadratic Score (QS):Three Components 


Attention Task 
1. Mean Latency (M):One Component 
2. Difference (D):Two Components 
3. Median Latency (Md):Two Components 


4, Standard Deviation (S):Two Components 
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or third components. Fortunately, it was possible to test the validity 

of the first components. This was done by removing the trial means from 
the original data matrices and re-analyzing the data. The variance/ 
covariance matrix rather than the mean cross product matrix was used to 
compute the characteristic roots and vectors. The components extracted 
from the variance/covariance matrix were then compared to those extracted 
from the mean cross product matrix. If the data means produced an "extra" 


component, this should have been shown by the comparison. 


Identification of the Components 


Two approaches were taken in attempting to identify the components 
for the arithmetic task variables. The first consisted of rotating the 
Y matrix of component scores to a specific criterion and then comparing 
the rotated component scores with the reference variables. 

One criterion for a rotation, rotating to the data means, has 
already been discussed. Although the object of this rotation is to match 
the first column of V to the trial means, the rotation is actually 
carried out by putting a component through the centroid of the person 
configuration. It is thus a rotation in the person space. 

A second criterion for a rotation is that of simple structure in 
the person space. If there are groupings in the sample of students, such 
that one group of students load more heavily on one component than on 
other components and another group load more heavily on a different com- 
ponent, then an approximation to simple structure should be evidenced. A 
Varimax rotation was performed on the component score matrix Y for each 


of the arithmetic task variables. In addition, an Equamax rotation was 
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performed. Both the Varimax and Equamax rotations attempt to produce 
simple structure, but Equamax attempts to equalize the variance over the 
components. 

All three of the rotations were in the person space. In each case, 
the efficacy of the rotation was determined by examining correlations 
between the rotated component scores and the scores on the reference 
variables. For the present study, the reference variables represented 
the only independent information which could be used in identifying the 
components. In many cases, apriori knowledge of the mathematical (or 
geometric) nature of the components could be used as criteria for 
rotations in the trial space, but in this study, it was felt that there 
was no such apriori knowledge. 

The second approach to the identification of the components in- 
volves performing a principal components factor analysis. The Y matrix 
of component scores was combined with the scores on the reference vari- 
ables. A correlation matrix was then formed and factored. The factor 
loadings obtained were compared to determine the relations between the 
components and the reference variables. The factors were rotated using 
the standard factor analysis rotations, Quartimax, Equamax, and Varimax, 
and the solution which most clearly illustrated the relationships was 
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CHAPTER V 


RESULTS 


Analysis of Covariance 


The means on the arithmetic pre-test for the experimental and 
control groups were, respectively, 125.44 and 136.55. Obviously, the 
randomization did not completely eliminate the initial group differences 
in arithmetic ability. As discussed earlier, the analysis of covariance 
adjusts the dependent variable for linear differences on a concomitant 
variable. 

The table below gives the results of the one-way analysis of co- 


variance on the arithmetic post-test scores. 


Score DF MS = P. 
Group is 20134572 5.456 0.026 
Within eS) 369.0378 


The adjusted group means for the post-test were 126.13 for the experi- 
mental group and 111.09 for the control group. The difference between 
the means was significant at a level of .026. (Less time was given on 
the post-test. Thus, in general, the scores were lower than the pre- 
test scores.) 

The post-test, of course, measured only the area of arithmetic 
that was covered on the drill sessions. Nothing can be deduced about 
possible transfer effects to arithmetic performance in general. But the 
hypothesis tested was that some type of learning took place during the 


drill sessions. Since the post-test scores for the drill group were 
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significantly greater than those for the control group, this hypothesis 


was confirmed. 


The Scoring Systems 


The number of components judged to be significant for each of the 
arithmetic task variables is given in Table 4-7. As expected, the two 
scoring methods which combined latency with correctness yielded more 
components (three) than the methods which used number correct (two) and 
mean latency (two). The correlations between the scores on these various 
arithmetic components appear in the upper section of Table 5-1. These 
correlations give an indication of the relationships among the components. 
Based on the extremely high correlations between the first components for 
Number Correct (NCl1), Linear Score (LS1), and Quadratic Score (QS1), it 
appeared that these three components were virtually identical. The first 
component for Mean Latency (ML1) was significantly (but to a lesser degree) 
correlated with the other first components. 

The middle section of Table 5-1 contains the correlations between 
the arithmetic components and the attention components. In the lower 
section of the table are the correlations between the arithmetic com- 
ponents and the reference variables. A check of these correlations 
confirmed that there was little difference between NCl, LS1, and QS1l. 

The second component for NC was very similar to the second com- 
ponents for LS and QS but it was virtually unrelated to the second 
component for ML. The second ML component was significantly correlated 
with two of the QS and LS components, but had no significant correlation 


with either NC component. 
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All of this indicated that at least three components are neces- 
sary to completely describe the data. If the two NC components were used, 
the information contained in ML2 would be lost. Similarly, if the two 
ML components were used, the information contained in NC2 would be lost. 
In other words, if the arithmetic task was scored by counting the number 
of correct answers, the scores yield two components. If the mean latency 
was used, the scores again yielded two components, one of which was dis- 
tinct from the two components for the number correct scores. Both weight- 
ing systems, linear and quadratic, resulted in scores which yielded three 
components and it appeared in each case that the three components contain 
all of the information that was contained by both the two components for 
ML and the two for NC. 

Some mention should be made at this point about the correlations 
between two sets of component scores for the same task variable. The 
scores on ML1 and ML2, for instance, were significantly correlated. The 
intercorrelations were not zero as in factor analysis because of the 
presence of the data means. It will be seen later that when the first 
component by itself reproduces the data means the intercorrelations 
become zero. (They are also zero for the covariance solution.) But 
where each of the components reproduces part of the data means, the inter- 
correlations will not, in general, be zero. 

The seven rows in the middle section of Table 5-1 contain the 
correlations with the attention task variables. The only attention com- 
ponent which consistently showed significant correlations with the 


arithmetic variables was the first Difference component (D-1). This com- 
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ponent correlated significantly with one arithmetic component for each 
of the four scoring methods. This consistency indicated that there was 
indeed a relationship between the attention task and the arithmetic task, 
and that in this instance the difference score was the most sensitive 
measure of the common phenomenon. 

The lower section of the table gives the correlations with the 
reference variables. It should first be noted that there were no refer- 
ence variables which showed a significant correlation with one of the 
components for NC or ML but not with one of the components for LS and QS. 
This tended to support the idea that either the linear scores or the 
quadratic scores contained by themselves all of the information contained 
by both the number correct and mean latency scores. The discussion that 
follows will concentrate on the identification of the components of the 
linear and quadratic scores. 

The first component for both LS and QS was seen to correlate most 
highly (.67) with the score on the arithmetic pre-test, (RV1). It was 
also significantly (.58) correlated with the comprehension score on the 
reading test (RV6) and had a correlation of .41 with the digit span score, 
(RV9). This first unrotated component was thus related to some specific 
ability as measured by the three reference variables. The actual com- 
ponent curves are graphed in Figure 5-1 and Figure 5-2. Both of the 
first curves had a shape similar to that of the traditional learning 
curves. In fact if the average learning curves for these data were 
graphed, their shapes would be the same. The shape of the curve sug- 


gested that this first component accounted for most of the learning that 
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had occurred and, as might be expected, initial ability in arithmetic 
had something but not everything to do with the first component. 

The second LS component and the third QS component were quite 
similar in several ways. First, they both showed a significant corre- 
lation with the attention task component and second, the shapes of these 
two curves were remarkably similar (after the first trial). LS2 had a 
significant correlation with the digit span but QS3 had no high corre- 
lations with any of the reference variables. These components seemed to 
represent the level of attention. The shape of LS2 was interesting in 
that it rose from trial one (on a Monday) to trial four (on Thursday) 
and then dropped for trials five and six (Friday and Monday) before the 
curve rose again for trial seven (on Wednesday). This "weekend effect" 
seemed to give additional support for the identification of the component 
as relating to attention. 

The remaining curves, LS3 and QS2, showed significant correlations 
with arithmetic pre-test, digit span, comprehension and vocabulary. The 
correlations, while similar, were not exactly the same for the two com- 
ponents. The curves were of no obvious aid in identifying these components. 
Based on the correlations, they appeared to be related to a more basic 


cognitive ability which effected the student's performance in arithmetic. 


The Data Means 


The object of much of the remainder of the analysis was to look 
for a method of clarifying the meaning of the components. But before the 
rotations are discussed, the solution with the data means removed will be 


examined. The correlations for the component scores from the covariance 
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TABLE 5-2 


CORRELATIONS 


TRIAL MEANS REMOVED 


TS LS2 iso Qs1 Qs2 Qs3 
Tce. 1.000 -.000 -.000 942% 0.003 .003 
LS2 -.000 1.000 000 006 931% 087 
LS3 -.000 000 1.000 002 087 938% 
Qsl 942% 006 ee a02 1.000 000 -.000 
Qs2 =003 931% 087 000 1.000 -.000 
Qs3 .003 -.087 938% 000 =.000 1.000 
D1 £195 ~.594% 338 .186 ~.536% 396 
D2 =nO78 =5078 -. 208 ORG Se 100 Sey) 
RV1 669% 370 159 678% 405 114 
RV2 244 we 146 F223 185 mia 
RV3 <cdyhl ers eei115 SGV OE) -.095 
RV4 2 | ~.068 -.000 SeLOs e208 “OL 
RV5 . 320 267 346 322 304 345 
RV6 588% £214 eel 588% ae: py 
RV7 . 306 289 O71 279 325 042 
RV8 .059 .039 =429 084 = 00 Soa 
RV9 .410 479% sia 413 487% .078 


* Significant at .05 level 
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solution are given in Table 5-2. The correlations for LS1, LS2, and 

QS1 were virtually unchanged. The last two QS components were now 
almost identical to LS2 and LS3. In Table 5-3, the correlations between 
the component scores of the mean cross product solution with the covari- 
ance component scores are given. The diagonal elements of this matrix 
confirmed the relationships found in Table 5-2. 

It is important to note that removing the trial means from the 
data had little effect on the first component. Thus the argument that 
the first component is produced by the data means is seen to be in error. 
While the data means inflated the relative importance of the first com- 
ponent (by increasing the size of the first characteristic root), they 
did not change the nature of that component. The curves for the Linear 
Score covariance solution are shown in Figure 5-3. Note that the first 
component no longer resembled a traditional learning curve although the 
component scores had the same rank order as the component scores derived 
from the cross product solution. 

Removing the trial means had some effect on the lower order com- 
ponents. Both scoring methods resulted in essentially the same three 
components. The second components, both QS2 and LS2, were still related 
to the level of attention. The curves, although reversed, showed even 
more clearly the "weekend effect" mentioned earlier. The third com- 
ponents no longer showed any significant correlations with other vari- 
ables. There was no basis for their identification. 

In this study, the choice of which solution, the cross-product or 


the covariance, to employ was not crucial. However in going to a covari- 
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ance solution, the information contained in the variance of the trial 
means is lost. Since for this study that variance represented learning 
and not a scoring artifact, a decision was made to proceed using the 
cross-product solution. 

The results from the covariance solution did, however, make it 
clear that aside from the variance of the means, the linear score and 
quadratic score components are essentially identical. Since the means 
varied in a similar manner for both, there was no longer any need to 
retain both variables. The linear scoring method was simpler and for 
that reason the remainder of the analysis was carried out only on the 


linear score components. 


Identification of the Components 


The component scores obtained after the three rotations discussed 
in Chapter IV were compared with the scores on the reference variables. 
The correlations are given in Table 5-4. In no case did identification 
of the components appear to have been clarified. The decision as to 
whether or not to retain the rotated solution is, of course, an arbitrary 
one but one factor should be considered. After a rotation, the com- 
ponents are no longer arranged in order of magnitude. If a rotation does 
not significantly aid in the identification of the components, the un- 
rotated components should be retained for the information they contain 
about the relative magnitude of the components. Thus for this study, the 
rotated components were not retained. 

The second approach to the identification of the components is to 


perform a factor analysis on the unrotated component scores and the scores 
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on the reference variables. The factors obtained are then rotated to 

a simple structure criterion. The factor loadings obtained for the 
components and reference variables after an Equamax rotation are given 
in Table 5-5. The unrotated loadings and the loadings after the Varimax 
rotation were similar to the results for the Equamax rotation. 

Scores derived from the first component loaded most heavily on the 
first factor. This factor was related to the arithmetic pre-test, the 
reading test, IQ, and digit span. The identification given earlier, i.e. 
ability and understanding as relates to the specific arithmetic task, can 
not be improved upon. 

The second factor was quite obviously a reflection/impulsivity 
factor, but it appeared to have little relation to any of the components. 

The third factor seemed to involve the level of attention. The 
loadings on this factor for LS2 and Dl confirmed the relationship postu- 
lated earlier between the arithmetic and attention components. In 
addition, digit span loaded heavily on this factor, supporting its identi- 
fication as an attention factor. 

The last two factors gave some information about the identity of 
the third component. The fourth factor appeared to be age with vocabulary 
score loading heavily on it. The last factor was highly related to the 
second attention component and had a high loading for digit span. Again, 
the last component (LS3) which loads on both these factors as well as the 


first factor, seemed to represent a general ability component. 


Individual Differences 


The object in applying component curve analysis to learning data 
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is to simplify the investigation of individual differences. For average 
learning curves to adequately represent the data, all students must have 
the same basic learning curve. In the component curve analysis which has 
been performed on the Linear Score variable, not only were three curves 
used to represent the data, but in addition a measure was provided which 
indicated those students whose scores were not fully accounted for by 
even three components. This measure was the error percentage. Table 5-6 
shows the percentages for each of the students. From this table it can 
be seen that Person 1 and Person 18 have the highest error percentages. 

A check of the raw scores for these persons (given in Appendix F) showed 
that their scores followed a pattern quite different from that of the 
other scores. In each case, the scores dropped on the third trial and 
last trial. Person 18 is especially interesting in that he appeared to 
have reached a peak by the second trial and then stopped trying until the 
sixth trial (on Monday). The error percentages could be investigated 
further and all of the scores of those persons above the average error 
percentage could be examined to see in what way they differed from the 
others. 

Possibly of even greater importance in examining individual 
differences are the component scores. These are given in Table 5-7. The 
scores for Person 1 and Person 18 were greatest for the attention com- 
ponent indicating that perhaps their erratic raw data scores were due to 
their inability to concentrate on the task. 

Person 17 attained the highest raw score during the drill sessions. 


Her scores were seen to be greatest for the first component. The second 
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component was more important in the scores for Person 8 who had high 
scores throughout the drill. Despite the similarity between their raw 
scores (and between their error percentages), these two students could 
be seen to differ in some aspect of learning. Just what this aspect may 
be was impossible to say due to the rather tentative identification of 
the first two components, but where the components can be more clearly 
identified, comparisons such as this should reveal much about individual 


differences. 
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CHAPTER VI 


DISCUSSION 


Computer-Assisted Drill 


While the purpose of this study was not to judge the value of 
arithmetic drill on the computer, it was interesting to note that sig- 
nificant improvement was found for those students who worked on the 
drill program. The tests upon which this finding was based were con- 
structed to measure only that area of arithmetic which appeared in the 
drill. Nothing can be said about any transfer effects to other areas of 
arithmetic performance or to general arithmetic ability. Yet after seven 
half-hour drill sessions, the students in the test group were able to 
solve more of the expressions in a given period of time than were their 
peers in the control group. 

The drill program used in this study was constructed for research 
and not designed for teaching. A "real" drill program would take into 
account not only error rates but the nature of the errors made. For 
instance, problem numbers such as zero or unity could be programmed to 
appear more often until the student no longer missed any expressions 
containing those numbers. In the present study, boredom was welcomed 
and even predicted as a variable but for actual drill sessions, the 
objective should be to eneere a high level of attention. As attention 
wanes the stimuli could be varied or a completely different task could 
be initiated. 


There is an important benefit of any computer-assisted learning 
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which this study illustrates. That is the ease with which the data can 
be analyzed. Figure 6-1 gives a sample of the print-out which was 
obtained for each student after each session. This information can be 
made available to the teacher as soon as a session has been completed. 

In actual practice, the data are usually stored either on disk or 
magnetic tape and the print-out is obtained later in the evening when 

the computer is no longer required for instructional purposes. Where a 
second computer is available, or if the central processor is sufficiently 
large, the tape can be processed at any time. 

The analysis described in this paper was performed over the course 
of several months but there is no reason why the results of a component 
curve analysis, or any other sophisticated form of analysis, could not be 
made available immediately with virtually no human processing of the data. 

While the data analyzed here has been from drill in arithmetic, the 
techniques described can be applied to any learning data (whether or not 
it is a result of computer-assisted instruction). Many basic learning 
tasks can be programmed onto the computer. Several discrimination learn- 
ing tasks, for instance, have been programmed for the computer at the 
University of Alberta. Even pre-school children can use the terminals 


with no difficulty. The possibilities are extensive. 


Component Curve Analysis 


The technique of component curve analysis which was applied to the 
learning data in this study yielded extremely promising results. Despite 
the limited number of people and the relatively small number of trials, 


the components from the arithmetic task obtained were seen to be sig- 
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ID NUMBER DATE TIME 
PROBLEM ANSWER LATENCY NO. RIGHT NO. WRONG 
8+ 8 = *k 14 4.5 0 al 
6+ 2 = *% 8 SHS 1 1 
SS as 6 3.0 2 1 
4-1 = *% 3 a. 3 1 
RK +93) =9 6 200 4 a 
xk + 7 = 16 2 fho8) 5 1 
xk - 4 = U 1.0 6 A 
xk - 8 = sd 1.0 i 1 
SUMMARY 
RIGHT WRONG QUAD. SCORE LIN. SCORE MEAN LATENCY 
i 1 SW 8) UH Sheed} 2 
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nificantly correlated with reference variables. Perhaps even more im- 
portant, the sets of components obtained from the different arithmetic 
task variables were seen to be surprisingly consistent. The analysis 
showed that by weighting the scores with the latencies, a more de- 
scriptive score can be obtained. 

The results for the attention task were not as good. One of the 
components could be related to the arithmetic task, but the components 
from the various scoring methods were not as consistent as those from the 
arithmetic data. Part of this inconsistency may result from the nature 
of the task. The students for the most part found the task a pleasant 
diversion after the drill. Increasing the length of the attention task 
might result in a more sensitive measure of the level of attention. It 
is not surprising, though, that the difference score yielded the com- 
ponent which was seen to correlate with the arithmetic component for, 
unlike the median and mean score, a single difference score indicates 
the change in level of attention during a single performance of the task. 
It would be expected that however stimulating the attention task, a 
student who is becoming bored with working at the terminals will perform 
more poorly on the second half of the task than on the first. 

Earlier some of the problems with component curve analysis were 
discussed. Of those, the most important is probably the problem of 
choosing the number of components. Because the magnitude of the charac- 
teristic values is determined by the size of the scores in the original 
matrix, there is no simple criterion such as stopping when the values 


are less than one. The jackknife technique used in this study to group 
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the characteristic values was found to be helpful but it does not pro- 
vide the desired statistical test of significance. For studies similar 
to the present research, lack of such a test may not be very crucial. 
But research into more basic learning tasks requires a more reliable 
method for determining the number of components. 

A computer program has been written at the University of Alberta 
which uses a Monte Carlo technique to create "instant" distributions for 
characteristic values. Knowing the distribution of the roots for 
randomized matrices should make it possible to determine which roots of 
the data matrix correspond to real components and which to random com- 
ponents. It is hoped that this work will result in the desired statisti- 
cal procedure for determining the number of significant components. 

The second problem relates to the data means. For this study re- 
moving the trial means did not significantly alter the solution. However 
there are cases where the trial means probably should be removed. For 
instance, if the number of problems given in each drill session had varied, 
then the variance of the trial means would have represented not only learn- 
ing but an externally imposed constraint. In this case, a covariance 
solution would probably be more valid. For many situations, however, the 
trial means may represent an important part of the data and thus should 
be retained for the component curves to more accurately describe the 
learning that has occurred. 

The major problem with rotations is that the simple structure 
criterion used in factor analysis has limited value. New rotations which 


are valid for learning data will have to be derived. If there is apriori 
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knowledge of the nature of the components, then a target matrix can be 
constructed for the trial loadings and a rotation based on a least 
Squares fit obtained. 

For the present study, none of the rotations improved the solution. 
The factor analysis was useful but no concrete identification could be 
made for the second component. Obviously the more reference variables 
and the more coherent the reference set, the better chance of identifying 
the components. Of course, the simpler the learning task analyzed, the 
more readily the components can be separated and identified. If this 
study were repeated, two changes would be made. First, a more coherent 
set of reference variables would be used and second, the task would 
consist of one type of problem which was equally unfamiliar to all of 
the students. 

The identification of the components is crucial to the investi- 
gation of individual differences. It is a simple matter, if the com- 
ponents are known, to look at the magnitude and sign of the component 
scores to determine which components underlie each student's scores. 
The technique is limited only by the reliability of the learning data, 
the availability of suitable reference variables and criteria for 
rotation. 

It is obvious, of course, that the technique of component curve 
analysis has not been developed to the same extent as factor analysis. 
But where learning data are involved, especially data from computer- 
assisted instruction, the technique may well provide the desired re- 
duction in data while at the same time aiding in the investigation of 


individual differences. 
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APPENDIX A 
AUDIO SCRIPT FOR ARITHMETIC TASK 


Hello. Today we are going to work on arithmetic. I will give you 
a series of arithmetic problems. They will be in the form two 
plus three is equal to five. Look at the sample problem on the 
screen. 


(End of segment - Pause!) 
Each time, one of the numbers will be missing. Your job is to 
supply the missing number. For instance, I might give you the 
problem two plus three is equal to blank. Look at the problem 
on the screen. 

(End of segment - Pause!) 
You would supply the missing number, in this case a five. 


(End of segment - Pause!) 


I might give you the problem in this form, two plus blank is equal 
to five. 


(End of segment - Pause!) 
You would supply the missing number, a three. 

(End of segment - Pause:) 
Or I might give you the problem blank plus three is equal to five. 

(End of segment - Pause!) 
You would, in this case, supply the two. 

(End of segment - Pause!) 
Watch the sign carefully, It may not always be a plus sign. 
Remember that you are to fill in the blank wherever it appears. 
On the top row of the keyboard in front of you, you will see 
numbers. Instead of writing down your answer to a problem, you 
will give me the number by pressing those keys. Note that the 
numbers are from zero to nine. If the answer to a problem is larger 
than nine, you will have to press two keys. For instance, if the 


answer to a problem is thirteen, you will press first a one and then 
a three. When you have pressed the number that you want, you must 
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then press the long space bar at the bottom of the keyboard. If 
you have answered correctly, your answer will appear in the blank. 
If you have not answered correctly, your answer will appear 

at the bottom of the screen. The correct answer will then appear 
in the blank. If you do not understand these instructions, raise 
your hand and someone will come to help you. If you do understand, 
press the space bar at the bottom of the keyboard and we will begin. 


You will have to answer more quickly. Remember that once you have 
pressed the number that you want, you have to press the space bar 
at the bottom of the keyboard. 


Good! 

(End of segment - Pause!) 
Correct: 

(End of segment - Pause!) 
Right! 


(End of segment - Pause!) 
You are doing very well! 
(End of segment - Pause!) 


Very good: 


You have worked very hard. On the screen you can see how many 
problems you have done correctly. Goodby for now. 
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APPENDIX B 


AUDIO SCRIPT FOR ATTENTION TASK 


Hello: We are going to play a game with numbers. I want you to 
tell me, as quickly as possible, whenever a number appears on the 
screen in front of you. 


Look at the keyboard beneath the screen. At the bottom of the 
keyboard is a long key. It is called a space bar. You can tell 
that a number has appeared on the screen by pressing the space bar. 


Remember how the game works. You are to press the space bar as 
quickly as you can whenever you see a number on the screen. But 
you are to press the space bar only if a number appears. 


If you understand how the game works, press the space bar and we 
will begin. 


Wait for a moment and someone will come to help you. 


That was very good. We are finished with this game. Rest for a 
moment and someone will show you what to do next. Thank you for 
playing. Goodbye for now. 


No! That was not a number. Remember that you are to press the 
space bar only when a number appears on the screen. 
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SCORES ON REFERENCE VARIABLES 
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1 Derived by Regression on RV5, RV6, and RV/. 
2 Derived by Regression on RV5, RV6, and RV8. 
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3. Dervied from Median Scores of Experimental Group. 
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ARITHMETIC PRE-TEST AND POST-TEST 
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PART 1 —- ARITHMETIC PRE-TEST 


PART 1 — ARITHMETIC POST-TEST 
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DIGIT SPAN TEST 
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The A Spans are presented in one ear (randomly chosen) and the B Spans 
in the other. 


Scoring System: 


1) Two points are awarded for each number in its correct 
position 


2) The numbers not in their correct position are searched 
and two points are given for each correct run of two numbers. 


3) The total of these two scores is changed to a decimal 
by dividing by twice the length of the span. 


Example: 
Span Given = en ous) 20 
Span Repeated = 4 2 7 9 6 
1) The 4 and the 6 are correct - 4 points 
2) ‘The 2 and 7 are a correct run — 2 pofnts 


3) Scores is 6+ 10 = .6 


The score on the digit span variable is the sum of the scores on all 
eight spans. 
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ARITHMETIC TASK DATA AND RESULTS 
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ARITHMETIC TASK VARIABLE TWO - MEAN LATENCY 


ORIGINAL MATRIX 


x" 
TRIAL 
PERSON 1 2 3 4 5 6 7 
1 10.30 LO 330 8.90 10.10 hPa) Oma 9.80 
2 9.00 8.00 6.40 8.10 8.20 8.30 bin 
3 8.40 8.20 8.10 7.00 6.70 8.60 8.20 
4 10.40 8/0 10.40 8.40 10.10 8.80 8.70 
5 9.50 8.10 7.80 7.60 6.70 9.80 7.50 
6 O20 7.30 7.30 6.70 7.00 80 8.50 
i 11.80 10.30 10.70 12,90 11.40 10.20 13540 
8 7220 6.50 6.50 6.80 6.40 6.00 6.00 
9 8.40 9.20 7.50 7.70 9.30 8.10 8.30 
10 12.60 8.70 9.10 9.30 9.10 9.50 10.00 
i SY) oo) 7.30 8.00 8.00 8.70 8.60 
i 9.90 o.2U Talo 8.70 He 1) 6.80 9.10 
13 12/0 9.80 8.60 8.90 9.50 9.70 9.20 
14 10.80 11530 10.40 8.90 9.00 9.70 9.10 
ds) 7.80 5.90 5.80 4.90 5.10 bew0 4.90 
16 9.40 9.00 6.40 7.90 7.00 7.00 8.20 
iy 7.00 6.30 5.80 5.00 4.90 4.90 4.40 
18 22570 8.70 13.70 14.80 14.00 9.40 3 32.0 
TRIAL 9.8 8.4 822 8.4 8.3 8.3 835 
MEANS 
STD. DEV. 1.8 1.4 2.0 pape nee 1.6 pay 
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ARITHMETIC TASK VARIABLE TWO - MEAN LATENCY 


MEAN CROSS PRODUCT MATRIX 


XX'/N 
ip z 3 4 5 6 7 
1 99.204 84.269 83.6135 85.685 83.956 aie ea yew 86.748 
2 84.269 Fe ey MUA} ROE SNe) 136 13p ly LIB IS. 74.068 
3 83,135 LOE 935 723 UD 7722) 712850 FO soO2 732199 
4 59.005 752138 13-255 76.490 74.437 72.660 76.743 
=) e930 Te 28 TALS 1@) 74.437 Visio abs).) e205 74.826 
6 So e201 PENS TSP 70.502 72.660 JA e203 71009 73.649 
7 86.748 74.068 C3199 76.743 74.826 73.649 772003 


CHARACTERISTIC ROOTS 


CHARACTERISTIC D.F. D.F. MEAN SQUARE 
Eee ROOT NUM. DEN. RATIO 

1 537.040 24 102 391.851, 

2 2.977 22 80 3.802 

3 0.937 20 60 eral 

4 0.788 18 42 1.637 

5 0.547 16 26 1.546 

6 0.364 14 12 1/473 

7 0.212 12 0 0.0 


Significant for Fegs 
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CHARACTERISTIC VECTORS 


V 
a  e————————————————————————————————————————O 
il vs 3 4 5 6 7 
1 0.428 -0. 330 -0.824 0.079 0.046 =—0. 137 -0.054 
2 0.366 -0.513 0.400 OF 019 0.638 0.188 0.029 
3 C3505 0.214 -0.055 -0.716 =) .133 0.530 -0.091 
4 od 2 0.468 OF LO7, OnL39 0.143 =02039 -0.706 
5 0.367 0.394 0.111 -0.286 0.184 -0.649 0.436 
6 Us I09 -0.416 0.366 -0.005 -0.693 -0.247 =Oi5 L359 
7 Ov 19 OEaa8) 07032 0.545 -0.196 0.419 OS a29 
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aa.0 MLd.0- ABE. 0 ABS, 0- 1r£,0 Ace, 
RED 0- yao .0- E@a.0- 260, 0- aab,0 ALA. aa 
ese. Q14.0 eet .0- cheio SOU, | oa ce. i 


— ——————— 
_ 
6 
_ = 


102 


ARITHMETIC TASK VARIABLE TWO - MEAN LATENCY 
CHARACTERISTIC ROOTS 


a Se rr ee ee ne ee ia ee 
SSS —————=xaaoaNaoOoaouououoaoaoaoaoaooaoooaoeoooooeeeeeeeeeeeeeeeee 


BEST SINGLE STANDARD INTERVAL 
VALUE DEVIATION tee 2A) 

36.50 52.24 426.34 < Ay = 646.79 
2.09 1.64 =0.57 = ho < yn oe) 
On7s 0.17 0.43 & ds < Ls 
1.06 0.30 0.42 Ss, dy < AEROS) 
OL7 i 0.16 0.38 < ds < 10S 
0.45 0.15 0.14 = re < Om. 
0.41 OLeL2 0.16 = Ao < 0.66 

COMPONENTS 


Groupele—L 
Group 23) 2 


Group 33574, 5 kOe vi 


 BtyeHOmMMOD 
£ «31 quoz 


& 3% queto 
Td .¢ #8 YE s€ quod 


— ————— oem 


103 


ARITHMETIC TASK VARIABLE TWO - MEAN LATENCY 


TRIAL LOADINGS 
B 


ea ee a ee a eee 


COMPONENT 
TRIAL aL 2 3 4 5 6 7 
+ oh la! AU) Og oT 0.070 0.034 -07 0835 -0.025 
7 8.482 -0.885 Ooo7 0.017 0.472 0.113 0.013 
3 8.412 0.369 -0.054 -0.636 =02093 07320 -0.042 
4 8.696 0.808 0.103 2205 0.106 -0.054 SU SV) 
2) Orolo 0.611 usally Oe 4 0.136 Uys 02201 
6 8.421 Oe 02354 -0.004 SOS HhS) On 149 -0.064 
i! 8.780 0.440 Wes Oo 9 8 0.484 -0.145 Or2o8 0.243 


COMPONENT SCORES 


va 
COMPONENT 
PERSON i Z 3 4 5 6 7} 
4) lc O =. J305 1.446 Clo77 =O02772 so Oe Ro -0.984 
2 0.894 -0.436 0.475 0.142 OZ561: = 2,002 =1205 
3 0.900 =-0.627 0.841 On 27 -1.074 1,705 0.382 
4 1.069 0.230 -0.149 cy Pim) =()/ oo =o hs SHAY 
2 Ue 951 =4 07) 0.378 -0.154 =1.3860 0.095 -1.780 
6 0.916 -0.802 -1.545 0.541 =D 0,252 ho SS 
7 i bey Hl led 1.324 0.624 1.584 -0.008 U.095 UO jjal bas pe) 
8 0.741 WhalO es) O39 -0.434 0.579 Bl OAL Qe) 
9 Vee se) -0.140 1.478 WesPAeX8) i bel ha 2) a7, i aichy an od 
10 ee MWAW) =—OE2 90) Sale Oe 0.460 -0.840 Oreo OsZ 4 
digi 02905 0.248 1.421 0.479 =e oS -0.429 0.693 
12 OF933 Ol L3 Abs TAPES: 1.649 1.124 OagoL -0.056 
lis! Ney gl -0.890 =1.206 0.130 U.2oL OU 0.441 
14 Haas -0.867 0.866 ales SISK) 00> ets O. -0.186 
ibs) 0.655 -0.752 -1.164 Wes AGS) 0.294 0.110 disso heieh 
16 Ooo =0).575 -0.054 1.442 30 0.433 O.7039 
i, Oexepeal -0.661 -0.574 cl es fe 1.254 Uso1> eS, 
18 1.411 3.256 -0.766 =) 3079 Ae MESS SOY = (ess 
——— a 
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ARITHMETIC TASK VARIABLE THREE - LINEAR SCORE 


ORIGINAL MATRIX 


Xx! 
TRIAL 
PERSON a 2 3 4 5 6 Y 
i E2477 214.87 LO a7 248.73 266.40 Z59).70 143.47 
Z 240.30 S1L9%03 422.50 887.293 406.23 394.63 425.16 
3 402.33 406.96 398.50 439.20 465.36 418.06 416.03 
4 P5220 166.83 22s 171.43 218597 194.83 t75-67, 
5 200.43 50713 353.46 417.76 386.90 Syl SM eke) 419.73 
6 205.87 393.283 343 o3 416.86 340.13 324,13 SpA SAD) 
iL. 184.53 PAVE AND 296.00 AWS) PATA ehaxe} Sper ye)s} Wey? pet 
8 426.16 470.53 450.63 45 3.e9 441.53 470.46 449.13 
9 Bile O 365.63 410.46 LIEN Dye) 364.46 417.10 424.73 
10 (a ekele 105) 346.06 328.06 304.33 SHE ho S'S) 389.33 S80 073 
Rl 346.50 339525 434.16 409.16 429.06 376.43 Ql jJeas 
iw 342.30 366.20 428.90 B35—093 9835.03 424.80 338.00 
13 156.40 304.56 311460 SPAS A/S) raehele TT 220 .k7 SEE) 
14 235805 ie 00 302.30 Sey) 309.16 345.46 518.20 
ies) PANS Js wee) 452.90 444.20 471453 497.20 430.36 482.83 
16 342.26 349.50 461.56 BO 250 449.10 429.46 415.06 
ihe 7 389.20 433.03 433.53 470.76 Sve Ate 462.80 Deo 
18 106.17 236.60 145.90 94.00 169.90 HL ete NS: 195.40 
TRIAL 257.0 326.4 39240 eye real 364 ,9 363,1 Oi, 
MEANS 
STD, DEV. 98,7 ea cy '4 103.0 104.7 Sim falcon, 108.0 
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; 7 > a 
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ARITHMETIC TASK VARIABLE THREE - LINEAR SCORE 


MEAN CROSS PRODUCT MATRIX 
XX'/N 


i Z §) 4 5 6 ii 


Te 20253 98557 97430 101243 99882 98716 
90253 16139 2200 20595 125601 124042 122463 
Sas yey | 2 2 OL 134518 132029 130/91 134789 So 7. 
97430 120595 132029 132800 135890 133234 133187 
101243 UZ 2001 136791 135890 141437 138856 LaJd Zp 
99882 124042 134789 133234 138856 137914 135410 
98716 122463 1133927 NSH Mery) 137425 135410 136052 


NWO WN EE 


CHARACTERISTIC ROOTS 


CHARACTERISTIC D.F. D.F. MEAN SQUARE 
Mere ROOT NUM. DEN. RATIO 
i 862234.250 24 102 351. 780° 
2 oe hail Paes 80 LO kZ 
| 2747.768 20 60 1.844 
4 1440 .297 18 42 i109 
6) 1376.487 16 26 e353 
6 1090.014 14 12 1.660 
a 562.876 12 0 O00 


* 
Significant for F.95 


CHARACTERISTIC VECTORS 


at Z 2) 4 5 6 ] 
nnn nn aE aeEEanga En SInS ISU SgSRSESnSSSSSaSn nS 
iu Ceo -0.667 O2655 0.142 -0.044 07133 -0.024 
2 Caso -0.304 -0.630 0.404 -0.412 Oe LL -0.055 
3 O93 0.048 0.030 -0.726 -0.536 -0.164 Oh ORE F 
4 0.390 0,513 0.302 OU477. ere0's108) ee —0'392) © 0275 
5 0.404 0.058 -0.054 0092 ORS -0.181 0.843 
6 O78 =Or222 -0.267 -0.203 0.608 -0.336 -0.444 
7 O..395 0.380 0.088 -0.113 U,2oD Quy Gz -0.108 
————— ee Se 
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ARITHMETIC TASK VARIABLE THREE — LINEAR SCORE 


CHARACTERISTIC ROOTS 


ee eee 
eeeeoee—=“woeoaoooOanw"$<S$=$q$q$E=Eo— eee 


BEST SINGLE STANDARD INTERVAL 
VALUE DEVIATION ep tara WE) 

861689 94811 661639 < dy < 1061739 
PRS Mins} 578 1094 = dy < 3532 
2948 US! 1351 < hg < 4546 

506 90 316 < hi, < 696 
1988 36 1278 < des < 2697 
2109 587 872 < Ne < 3347 
1097 262 546 < ho = 1649 

COMPONENTS 
GiOUp wise 


Groupe: (mcs 
Croupes eee Ome? 


=a 
: - oa prea 
j aic “ay: 
A LOOR OLTETATTIA 
+ 


a 


sere ls J -  hOOE 
anes 2 £ A 2 © fett vey 
ota zi Tar 6% Ose G8 
Veoe pf 2 SySi ace 
VabE = yh > Sve iv ta 
PsOr > ch 2 one cas 
STUAKO MMOD 
; of of qvond 
€ .S ;S quero 
t 8.2 8 GE quam 
' : : 
oo - : ‘ oe 7 


ne 


: a - 
q rae — 7" 1 7 - “an Dee 
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ARITHMETIC TASK VARIABLE THREE - LINEAR SCORE 


TRIAL LOADINGS 
B 


SR SS a ee 
See aaa tana suarapieneansustinhebre Adasen siuasouiansooaisaiaovisseputiygasiessiowegpepesenpsperesseamesmenne saamenaaiawananetent mom nearer oe os ater mtomemenoete am aoe eo Eee 


COMPONENT 
TRIAL 1 Z 3 4 5 6 7 
a ee ee ee ee ee ee ee 
1 270.435 -37.746 34.348 ee Sey) -1.637 A399 = 205 19 
2 359-009) = 175175. -337022 O40 ee LOG Zoe 62954205 
3 BOD a5 2.091 1.593 =27,538 —-192900 =3429 04731. 
4 BO2eL 05 29.010 121 1 if Sop WO aA RAS a VP Sa VAS Ney oe! 
2) oes Ld SNOPAT Pl steep 3.494 UNG Syeyen Sep oy, SLet/ 20.010 
6 369.808 -12.574 -13.978 - 7.691 Zoo teal OSA 10RD 27 
7 S672 151 21 OU CPE ©) ts tn! WY AY 2 85/02 24030, = 4254954 


COMPONENT SCORES 


Vas 
COMPONENT 

PERSON iL 2 ) 4 5 6 7 

1 O93 -0.000 =02:839 TRIZOL 025703 -2.'683 0.699 

Z 1.068 1.041 -0.068 24 05259 0.146 0220 

3 19, -0.984 0.1992 1.408 -0.063 0.085 O926 

4 0.490 -0.395 0.035 1.136 e257, OF0Z2 0.964 

5 O15 18521 -0.168 0.215 O27 53. 0.082 -07421 

6 0.950 027 -0.526 1331 SM 235 )e) =), 925 -0.865 

7 On7 21 -1,.285 -1.408 -0.748 -0.455 -1.641 =O, 054) 

8 sys 3s) -1.440 0.451 OEIZ2 =i 7.36 O39 —loL9 

9 dee Le 0.149 0.405 -0.042 =03316 0.330 =28 510 
10 0.947 0.609 -1.844 -0.423 25, 0.640 0.345 
dal 19120 -0.036 12/9 -0.517 -0.482 0.226 1f08# 
2 1.065 -1.608 0.069 -1.142 -0.439 —0.603 =Orwiie 
1s 0.838 18185 -0.714 -0.929 -2.248 0.140 0.340 
14 0.827 0.963 Lez -0.894 1.818 -1.417 =e ly 
aE) 17261 0.813 -0.686 0.837 -0.410 Of613 Tcl 
16 1.143 -0.766 0.425 -1.826 O2Z50 0.154 dae 2 
Ly 1.303 -0.153 0.624 0.903 0.538 14353 0.239 
18 0.492 -1.054 =2.023 -0.206 1.306 dr225 =—a25 
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ARITHMETIC TASK VARIABLE THREE - LINEAR SCORE 


APPROXIMATION MATRIX USING 3 COMPONENTS 


x! 


108 


3 
TRIAL 
PERSON 1 he 3 ) 6 
iL 131.48 2206 oF 2D 201033 224.81 2305.92 Z APS ei 
2 247.20 342.13 392705 415.86 404.43 382.80 414.19 
=| 394.79 385 .00 435.79 420.41 443.06 440.99 422.75 
4 148.59 169.70 L771 82 166.42 182.42 185.60 TjA 49 
5 99590 Olas 22 EWS ycc bs) QU] s7 Si eseu), 354.69 410591 
6 200.03 S293 348.76 365.42 361.34 345.69 368.38 
7 Le Oe 309.97 257.46 201.36 270 a9 502202 2Sls 33) 
8 416.84 439.65 465.29 4297.93 ETSI 32) 486.26 442.17 
9 308.61 356.14 406.55 412.89 416.18 403.18 412.85 
10 169-85 SOT, 344.66 Soltol 362e7 L 368.42 Sevanes 
ins 348.10 SYS\Si5a0) 410.78 424.69 416.58 596.00 416.31 
ihe 35106 50263 384.63 340.05 394.22 ih shy Oe) 556378 
13 1ES)/fo, 38 283.90 307.98 326.44 520505 304.90 BZ 9R/0 
14 246.38 203.45 307.06 354.47 308.52 269.46 332.14 
15 250m 2 431.10 461.51 469.30 477.82 465.65 477.24 
16 352.66 Decry 416.02 398.46 425.36 426.46 405 20 
Ai 379.47 418.42 476.17 477.08 486.62 474.91 477.84 
18 103239 249.75 L/Sa70 115.61 186.92 DS 50 148.63 


gb4 | eS ; 
| , BAO HAAWTI ~ BBANT TIMALAAV xAAY OF aN 
aTvAnOIMOD € DATA KUTA HOTTA KATIA ea 
| a - - 
4 sSies ¥ Bits a 
7 ae vie ae 
t 3 Q a. a ii, 
“PREFS $8,065 fest Ef.105 PE. ers eo age ae, . 
eet «© OBLSBE «= MLMON «BATA ace EL, ONE 08. v8 
Qv.8hh CR.OAA dO.EAs ENLOSA eF.2E 0,288 er BRE, | é . 
Week ORLEBE | SHISBr «SbLBaLsBLCE (ON LORL, eA. 
fe.0f  Sd.see TS.t8E  Fe.the EL.eve Seance OR, eer 2 
BE.BGE OB.ehe AELTOE Sd.2ae av.BdE EeLNEE 80.008 a | 
CE.068 SE.SOE eL.ors on ad.ves  Fe,e0e: fO.eee Ln a 
Se ee) Se Se) $ 
28.810 Af.£0) BF.a0h a.ses 22.30) Lage —a080E engte® 
MELSZE = - SABRE eget geytee | Bac adE Ct. tae 8a 
(Arb = ON ORE | BELANA ea.) yond «= ake OBE 
EX.@CE OOVEIR SS.ARE eO.0bF Ed.NRE EFLSBE  sOLEee 
OY,GSE OROOE EELOSE AALOSE Be.TOE OOLesS Ie Her 
AISCE. adyOBS  S2.BOE - Vawee aOctOeE ea, £08 BE. ave 
ASUS = 2BIS = SALNNA =O. @0N ste TaN «On fe | 
CF.f0h = ABSA = ELSA NRBEE SOLANA PLES BE: 
MENAN = -FOOTA = SAL OMA BONS) ELTA Seah 
EAB DRESS SR. a: Laven OVECr A 
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ARITHMETIC TASK VARIABLE THREE — LINEAR SCORE 


RESIDUAL MATRIX AFTER 3 COMPONENTS 


(X - X,)! 
TRIAL 
PERSON il B 4 5 6 
Mu = (io 7A -11.40 -32.84 47.40 4159 ZOe16 
2 =O ao.) =e ANG) 29205 =20-03 iarel@) 1135 
5) 7.54 21.96 aS y/e7Ae) 18.79 22350 Seah ys) 
4 Stele = 260 =D .09 4.99 36m. 5S) 
5 0.53 = Hy) =21.0/ Ong = 8) SH Load 
6 5.84 SEW) ae SAS: 51.44 = 2a SPs Ne) 
ie -10.48 150) 38.54 ded 1.44 14.21 
8 Se SP 30.88 -14.66 Zo20U) —34.00 =Alisyatsll) 
9 SPae)!) 9.49 Geo: 12.34 eae 1h Dee 
10 Sees 2 veils (i —16.,60 sof Ms} 14.62 PAUSE 
iin - 1.60 =10.32 23.38 15.9 12.48 =20 527 
12 - 8.76 alls) SB) 44.27 oe 12 =i Tes Tall 
13 = (OSERS 20.66 69.82 - 4,71 -20.56 -48.73 
14 -13.35 -49.85 - 4,76 - 3,24 0.64 76,00 
15 VELG 2.00 -17.31 PARIS) Ske) ie SPA) 
16 -10.40 -32.61 45,54 -46.10 23.74 32.00 
17 rhs) 14.61 -42 64 = Ash! D4 el Br 
18 Pat he) -13.15 -27.80 ~21'..6.1 Se, 203 
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10.33 


34.69 


46.77 
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“pear seer ste arse 
Of .BS £2.08 sause BL. tS 
{St CS0h- BA, SI €2.er- 
ea Ted a 
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ARITHMETIC TASK VARIABLE FOUR - QUADRATIC SCORE 


ORIGINAL MATRIX 


xX! 
TRIAL 

PERSON at 2 3 4 5 6 7 
1 29.04 113205 80.22 135357 155216 144.16 40.03 
2 141.59 223.14 DIAL 286.90 302.43 286.96 331343 
3 304.14 309.86 296.89 346.31 373.44 316523 314.76 
4 O71. 92 59.66 19703 I5e04 Tt 707 SWS) 86.16 
3 102.64 20 Tao! 261,72 922,602 AN ile 267.00 316523 
6 Joes 248.30 ZR O9 324.46 243.07 LAO Ale MINS BMI 
7 88.55 201.49 LS72 5) et ON MOE) cic be 205.42 UD) 
8 OZ he 374.50 359.41 35.80 SOU aks) SHUT sks) Siew ks S7/ 
2 POIs U2 201 op, yz El) 326.80 249.51 305.73 B15 alo 
10 49.94 238 337, PAMe) oN) 1952.67 209 say ZO DUES SeENS) 
ital 246.83 V5E I 28) 334.38 3027.05 320.24 ZO se 308.48 
be 228.68 265.84 335.14 245.42 2 Sono S25 rao PDO RS 
13 42.70 204.68 270.50 217.67 ASHE O18) 149.37 208.68 
14 126.74 59726 202-99 248.60 207 733 234.24 213.56 
as ZO 2.01 30/507 361.86 396.33 416.28 SA lo 404.83 
16 241.83 PAS NMS) 368.84 Zens 349.24 CG YIAOY/ 309. 86 
ey SUZ 352.43 Bs ell 393.50 415.29 386.05 439.91 
18 Seow iGo pve 42.40 8. 09 66.11 aw AS beer f) Oy ue, 

TRIAL 154,0 MON) 254.4 2d 2ep 265.0 PRSEISE) Ze eel 

MEANS 

STD. DEV. 103,0 90.4 108.0 LOT sD oie Oo ay, 111.9 


i 


a 
ee eeeeeeoooooooeeoooeaeoeoeoeoeoeoeoeaeannasSsSsseeeeeeeeeeeeeeeeeeewewTrwTrree 0 O_O sc —— 


£0.00 An. wie 
EO,0e a8. aBS 
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ARITHMETIC TASK VARIABLE FOUR - QUADRATIC SCORE 


MEAN CROSS PRODUCT MATRIX 


XX" /N 
——————— eee 
1 2 3 4 5 6 7 
L. 34331 42206 48152 47362 49246 47484 47743 
Z 42206 60297 66000 65029 67885 65649 65786 
3 48152 66000 76385 74191 iy yal 73973 74915 
4 47362 65029 74191 75298 76291 72858 74696 
5 49246 67885 76721 10294) 79661 76183 77041 
6 47484 65649 TiSMTES) 72858 76183 74336 73930 
ii 47743 65786 74915 74696 77041 73930 76971 


CHARACTERISTIC ROOTS 


CHARACTERISTIC Diane Diets MEAN SQUARE 
COENEN ROOT NUM. DEN. RATIO 
1 465908.313 24 102 180.458, 
2 3606.148 22 80 1.780, 
3 2789. 332 20 60 1.828 
4 1560.080 18 42 1.206 
5 1370. 336 16 26 1.352 
6 1076.107 14 12 1.616 
7 570.817 12 0 0.0 


* 
Significant for F.95 


CHARACTERISTIC VECTORS 
V 


1 2 & 4 5 6 7 
ee... 
ul On 206 029353 0.184 08137. -0.036 02092 -0.020 
Us 0.354 -0.049 -0.677 0.194 =07493 0.364 =—Om0 a: 
8) 0.401 0.010 0.028 -0.907 =O5071 0.054 0.082 
° Oza93 -0.236 OR L9 0.187 -0.548 =Onoie =—0.291 
8) 0.412 -0.082 -02035 07220 OLS. -0.345 O87 95 
6 UaSiire 0.005 =Q5959 OQ, 052 0.493 -0.443 =O 1521 
7 0.402 -0.254 0.328 0.185 0.430 0.666 -0.064 
ees OO MlMn—m—uaununnn>x> 
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ARITHMETIC TASK VARIABLE FOUR - QUADRATIC SCORE 


CHARACTERISTIC ROOTS 


BEST SINGLE STANDARD INTERVAL 
VALUE DEVIATION C=222110 
465341 70631 316310 < hy =e OL4a3y2 
2975 611 1686 < hy < 4264 
Zi de 819 1044 < de < 4499 
1105 220 641 < hi, < 1509 
L207 370 G27 ES de < 2487 
L937 ay) 824 < re < 3050 
1046 280 456 < do < 1636 
COMPONENTS 
Group LL 


Group 3:7 2, 3 
Groups.) 45 5 Ones 


eTHSMOIMOD 
“ft oF quex 
| ES 2S quoxD 
. Ved ead 2 quar | 


FE A EO a QunhseSened apenas 
2 
e. 
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ARITHMETIC TASK VARIABLE FOUR - QUADRATIC SCORE 


TRIAL LOADINGS 
B 


a ee ee ge Oe ee ee Pe el ee ee 
rn EE a ee ee 


COMPONENT 
TRIAL i 2 3 4 5 6 7 
a 176.229 56.033 OR O07 LON e322 3.030 - 0.487 
2 241.815 = 2.915 —-35.769 7.650 -18.249 1 39 ees 0 
3 274.014 0.624 1.466 -35.838 - 2.616 da E966 
4 PAN eee Ay Wea by Zio o 2 7.379 -20.285 -10.240 - 6.943 
5 2815157 —  —) 4.927 =1 1.073 8.694 s\pes Sib Syki 1SE29 
6 270.691 Waatisy Saleh 250) 2.068 18.252 -14.546 -12.448 
ff ZIAS S215. 2465 17.343 7.324 15907 21. 83695 =i o2S 
COMPONENT SCORES 
ye 
COMPONENT 
PERSON i Z 3 4 5 6 7 
1 02399 -0.541 =l)e (isi One =Je/22 =F) LONE 0.380 
2 078 -0.842 OF 503 aa 5 che) 0.903 0.366 0.274 
3 Irae | 1.349 OA) LoL =e ao -O2o24 Oe val! 
4 Oe273 -0.260 -0.065 1.506 05/35 = 007 Oa 16 
>) 1.006 -1.510 0.954 Oe350 0.268 Ones == (ez) 
6 0.901 = Sh PAS 0.189 0.264 -2.147 -0.666 Oe 20 
vi Wiseren Oo M/ OS =() 900 -0.414 Siig RSV -0.018 
8 1.376 1.508 Oe QoL Waren) 0.790 el Ee 
3 LOS Ozla6 0.462 -0.360 -0.374 0.537 Seo LU 
10 0.868 =—L.6oL ile O09 0.499 L422 ez 6 0.314 
11 1.118 0.795 0.880 ~0.658 =0.055 Ve2e2 10977 
12 1.060 1.095 Ome =—1.342 Os Or! -0.904 -0.431 
13 We 7/58) —1.442 -0.042 = lia 2O Sil, SE) UTA OL ap led 
14 O73 =O 2LO 1.857 -0.264 Lewia =I. 927 mle 2s 
i) 1.402 -0.898 -0.041 0.747 -0.654 0.642 1.164 
16 1.174 C7052 =o lo 2 Aas Fh Ne eS) eae aah) 
uy, 1.468 0.530 0.416 1.418 0.452 0.942 0.091 
18 ORL =) 705 -2.056 OR 22 WPASe) 0.838 =-1.218 
————————————— nnn 
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APPENDIX G 


ATTENTION TASK DATA AND RESULTS 


ATTENTION TASK VARIABLE ONE - MEAN LATENCY 


ORIGINAL MATRIX 


bbb) 


a 
TRIAL 
PERSON 1 3 4 6 7 
i 130 voeL Lis 1.49 3) teed) DOU 
2 L'7 oe, ey 1.06 .13 0.94 1.89 
3 1.30 41 dle 995 shes eA 47 1.46 6592 
4 lo 7 oS 1.34 1.01 .08 1.00 0.96 
3 Mo 335) 50) 1.49 endl sole 3.26 IAS Shs) 
6 LO AOL 0.86 0.90 TO 0.85 0.81 
7 1.04 ~85 0.87 ESO os) 1228 IE Oe 
8 1.68 . 76 oe, 1.74 oo) L208 TO 
9 1.31 ~42 1.86 IBS) 232 IEA Be 1,34 
10 0.84 61 7 Oey 3 2)8) BS 0.90 
detb 0.84 -O1 the Bes) 1.02 . 86 1.34 iba) 
12 1.74 .03 el Qe74 239 1.42 2365 
13 1.40 AS) ihe eo ieliG ae) 1.60 0G 
14 the She) . 36 1.43 1.00 -56 1.06 2.44 
aes) eanQ2 S01 eeZi2 LeOi awl: 0.96 Deog 
16 1.20 wake Lire ESSA pei ees) 0.94 
17 1.24 24 00 0.96 Oui 0.98 1.08 
18 1.p2 . 86 1.54 iL es 83 5S 1.80 USS) 
TRIAL 1.30 44 il 20 iL 2 afve/ 1.34 eke 
MEANS 
SID SDEV-0725 54 O23 0.49 49 0553 0.67 
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ATTENTION TASK VARIABLE ONE - MEAN LATENCY 


MEAN CROSS PRODUCT MATRIX 


XX'/N 
Sona ee 
1 2 3 4 5 6 7 

rn, Se EE UN et ee ee, ee 

i 1.748 L925 14696 1.787. 1.686 Led, 2.068 

2 19925 Ze LiL 1.924 ibe ys) 2937 2.059 24236) 

! 1.696 1.924 1.726 ore 1.696 MV heys 2.006 

4 gy Roy 1.998 Wit SHE 1.966 1.808 1910 hy 3A Ce) 

5 1.686 ioe 1.696 1.808 1.841 eo 20 2041 

6 sy) 2.059 ie 1.910 125 20715 22 A0 

i 2.068 2503 2.006 1A PAOD) ays MA 2.210 hrs pik: 
ne ee ee ee eee 


CHARACTERISTIC ROOTS 


CHARACTERISTIC Doi. D.F. MEAN SQUARE 
Coane ROOT NUM. DEN. RATIO 
1 13.776 24 102 80.490, 
2 0.237 22 80 LL. 
3 0.208 20 60 ee 
4 0.160 18 42 3.040, 
5 0.085 16 26 3.659 
6 0.021 14 12 1.041 
7 0.017 12 0 0.0 


# 
Significant for F.95 


CHARACTERISTIC VECTORS 


V 
1 2 3 4 5 6 i 
it 0.348 = 2072 -0.442 0.375 -0.142 =0. 330 -0.479 
2 0.403 -0.450 -0.289 -0.624 0.388 0.080 -0.066 
3 0.345 -0.366 -0.210 O2253 Sea 0.438 0.374 
4 0.369 Oc 195 -0.019 Osa 19 0.673 Oialie Oper eae 
5 0.360 -0.053 0.424 —0.132 =-Q. 11> -0.628 Qpod2 
6 OL S77) -0.147 0.690 0.083 OSE! 0.249 = AS 
7 0.435 0.773 -0.144 -0.330 = eco 0.166 -0.041 
a aL a lea a te Ea > I Sr eee Sane ee Oe ES 


OTT2IARTIARAHD 
TOOR 


OITAA “ad MUM ie 7 
£028.08 cf as att 6% Lo ig : 
akevet | 08 ss: vES.0 g 7 
SNES. 8 08 os 808.0 a: oe 
,080.E gh al Oar,0 ry 
e2a.£ | as ar 280.0 @ a 
1A0.f cf MM 1£0,0 a a) ee 

| | T10.0 v - 


a00.9- det. a 
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ATTENTION TASK VARIABLE ONE - MEAN LATENCY 


CHARACTERISTIC ROOTS 


BEST SINGLE STANDARD INTERVAL 
VALUE DEVIATION Ge=e2. 110 
13.708 1.860 SE tee) < dy = 117,652 
Onno2 Os03 1 0.066 = hy ve Osi o 
Onbad 0.049 05035 < de 2 OAL 
05265 0.094 0.067 < hy, < 0.463 
Wg) 0.066 0.059 < he = 0.389 
0.019 0.005 0.009 = 6 = 0 029 
0.042 O01 1 O20L9 < ho Se (2065 
COMPONENTS 
Group 1: 1 


Group 23° 2, 3, 4. 5 
Group 2 0.7 


ae 


“eo 


- : 7 a 7 


7 3: : 
a 7 
> ol 


YOUSTAT MAEM -. 30 AIGATBAY AeA MOU TMaTTA 


S eTOOR DITETIAXTOARAHD 


— 
a a = 


aAvaaTuI GHACMATE 
a aa eri. al | MOLTAIVAG 


- Seatr = > Gh asy.e 0a8.f 
~ & 2 880.0 4€0.0 
260.0 | eb0.0 


ik & 80.0 £80 .0 


WV 


— 
e 
| 

> 

oe o 
vv WwW 
=~ 
ly 


eke.0 <= 5h «6 ~~ C0.0 A800. | 
| e00.0 . 800.0 
200.0 = <k .= 10.0 - “ff0.0 


‘eo 
fad 
~~ 
~~ 
* 
o 
a 
~ 
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ZTANVOIMOS 
I. :L-quexd i 
e ,f ,£ ,& <8 quoxd 
: ; quot 
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ATTENTION TASK VARIABLE ONE - MEAN LATENCY 


TRIAL LOADINGS 


B 
COMPONENT 
TRIAL u 2 3 4 5 6 7 
st 1293 =O2 059 =O 202 0.150 -0.041 =-0.077 =O 062 
2 1.495 0 AS, =0.132 -0.249 Uigala bs) 0.012 -0.009 
3 My Rey U —-Oni7 3 -0.096 0.103 -0.161 0.063 0.049 
4 1.369 0.094 -0.009 0.207 OL 96 ORO25 Oe Oe) 
5) ROOT -0.026 OF193 -0.053 -0.033 -0.090 0.067 
6 1.400 —O5071 0.315 050335 —On O17 0.036 -05070 
7 17614 0.376 -0.066 SANA GS y2 -0.068 0.024 -0.005 


COMPONENT SCORES 


val 
COMPONENT 
PERSON ab 2 3 4 ©) 6 ti 
if ZO0 2050 as a4 Pe 0.675 05709 EU Tooe 
Z 0.924 0.755 —1e018 0.214 -1.474 =15070 =O 563 
3 0.947 =-1.261 0.368 O12 =O 207 —O2050 Lyles 
4 08639 ales =-03/45 0.131 =O226 -0.845 -0.036 
5 1.620 0.410 3.405 -0.642 0.477 -0.668 =Un029 
6 0.627 =08275 -05183 0.697 =O@.153 -1.344 -0.451 
7 0.686 =OR0G9 0.361 0.542 -0.324 0.264 ences OT: 
8 On9 7a = 13025 = 204 1.041 1.548 =O5192 -0.544 
) 1029 =(506/ 0.106 On/1Z at Eat ba Ek 1.514 1.034 
10 0.748 = 1092 -0.366 -0.626 0.365 1.086 0.749 
LT 0.796 Oeloy 0.286 0.176 -0.883 2.764 =o, 
12 1.244 2039 -0.383 15976 e721 OBS09 0.877 
13 0.980 0.156 One 1a 0.288 -0.966 0.036 Lolo 
14 1.053 1.247 -0.601 OR 9 3i 2/2035 =QR929, 14502 
fy, Ofeiaae -0.418 -0.249 0.561 -0.471 Osal3 0.656 
16 0.815 -0.675 0.089 0.888 -0.094 -0.188 0.181 
17 0.758 -0.418 -0.526 0.163 -0.141 =-().619 Ons) 
18 J. 370 =)0 9D -0.179 =15.699 1.445 -0.344 0.542 
SSS 


£00. 0- {t0.0- 140,0- 
200, 0- 510.0 EIE.O 
@A0.0 £30.0 - Pol .0- 
260.0 é50.0 der. 6 
yoo,.0 0e0,0- ££0,0- 
QvO.0=' 0.0 VI0.0- 

acd ,0- sS0.0 8a0.0- 


— ce 
———————— ee 


TMaEvOmIM0d i 
t 3 c ne £ AM £ 

StB.0- e0T.0 28.0 res.S- ° Ste, I- DBO. 

ae .0- 0v0.I- ia t~ NIS.0 - £10, £- eev.0 

ESL. 22a. 0+ vos ,0- evt.0 BAE.0 tas, ti 

a0. 0- 208. 0+ acs; 0= f£f,0 eAt .Q- 8Il.I= 

e$0.0- 85a.0- ThA.0 $80. 0- 20h.€ Ofd.0- 

fed.0- AME. £2t,O~ £03,0 E8I.0- avs.0— 

Yoe .s- sa%..0 sce .0- SAa50 13,0 280,0- 

bh? 0+ SE1.0- Hie. f LAO s28yt-’ So.t 

NEO. fc. frt.1- $f .0 aor. 

eb, 0 o80, J dae .0 df3.0-  -. ad£;0- 


#48002 THEMOIMOD | 
Lin 7 7 


atr.0 aBS.0 
Ve. E E8E.0- 
B8S.0 Efs.0 


{ -O- Yea 08.0- 
162.0 p20 
888.0  .psoc0 
£aL,0 
shat SR 
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ATTENTION TASK VARIABLE TWO - DIFFERENCE 


ORIGINAL MATRIX 


sa 
TRIAL 
PERSON 1 2 3 4 5 6 7 
1 Sililip  erihn cS Oil Sith |e yiby) 0.36 0.82 
2 = Ogi 9 ew) Celoe Or tie | aOR TT 0.01 seek 
3 =0n18 ji 0-0-—  0rl rte Ocug P= OT 02 
4 = OL) WW <2) 07 A. Way SS 
5 - 0.46 1.99 OL = iar 2.25 2.82 0.16 
6 = 28) S00 0.16 0.06 0.06 O16) Mean Os0- 
7 =O Sy Eee EE Os SACs 0.42 
8 0.16 - 0.48 O70 lee 0026 0509 ame-On42 0.06 
9 = HS ine PS TS ae O20) 0162 ee - 0.79.  Oele 
10 0.02 Lee OS Oa Ceail 0.0 0.24 0.06 
11 = HOS 0.19 0.73 0.0 0.23 0.35 0.48 
U9) O30 0 00S 09 2,02 
13 a0 .34 6.0 > 0 O2050) 0102 ee O78 0.79 
14 0.09 0.49 0.41 0.33 0.99 Ogle Sw 
15 25 ee 04.09 0 2 Lee 0.09 0.09 Oe 
16 2 (iihl = tpiGe = Re kia See) TE he ee 
17 =/0.29 wet ae ee 0.05 OrUsm n=O. Ol 
18 ee ee eee Lien toe cde 1 aay Lae 
TRIAL  -0.22 yi See Stipe n Din Seow 0,35 
MEANS 
STD. DEV, 0.34 0.66 0.52 0.59 OES 0.85 0.76 


0d.0 - 
88.0 - 20.0 £0.0- 2040 at.0 - 
22,0 a Co a 
W.0~ eo- oc.0- 0- ese 

B00 = 40 


¢ 4a 
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ATTENTION TASK VARIABLE TWO - DIFFERENCE 


MEAN CROSS PRODUCT MATRIX 


XX'/N 
i 2 3 4 5 6 7 
1 0.167 -0.059  -0,012 0.055  -0.037  -0.068  -0.137 
2 -0.059 0.465 0.118 -0.036 0.398 0.368 . ~0.121 
3 -0.012 0.118 0.279 0.119 0.220 0,281 “*=01093 
4 0.055 -0.036 0.119 0.442 0.050 1-0.012 %,404363 
5 -0.037 0.398 0.220 0.050 0.536 0.412 | -0.227 
6 -0.068 0.368 (Oe28 1 = On 012 0.412 0.722 -0.176 
7 -0.137 -0.121 -0.093 -0.363 -0.227 -0.176 0.706 
CHARACTERISTIC ROOTS 
CHARACTERISTIC D.F. D.F. MEAN SQUARE 
pec hiaae ROOT NUM. DEN. RATIO 
1 1.621 24 102 4.060, 
2 0.898 22 80 4.091, 
3 0.308 20 60 1.888, 
4 0.226 18 42 1.994 
5 0.140 16 26 1.839 
6 0.084 14 12 1.778 
7 0.040 12 0 0.0 
* 
Significant for F.95 
CHARACTERISTIC VECTORS 
V 
2 3 A 5 6 7 
1 -0.018  -0.224  -0.129 0.300 -0.717 0.500  -0.281 
2 0.421 0.249 -0.476 ~-0.245 0.203 0.597 Ono7y, 
3 0.279 0.014 0.570 -0.237 ~-0.430 025 0.597 
4 0.146 -0.576 0.347 -0.461 0.282 0.304 _=01378 
5 0.512 0.124 -0.253 -0.394  -0.351 -0.477  -0.390 
6 0.567 0.285 0.403 0.548 G22 0.083 -0.282 
7 -0.375 0.677 0.292 -0.355 -0.092 0.257  =0.338 
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ATTENTION TASK VARIABLE TWO - DIFFERENCE 
CHARACTERISTIC ROOTS 


a ee ee eee ee 
ee ooo 


BEST SINGLE STANDARD INTERVAL 
VALUE DEVIATION t=92 2110 
A Eg) 0.472 Osis < hy = Z.L07 
dil a7 0.605 -0.100 < ho < 2.454 
0.244 0.082 0.072 < ds < 0.416 
0.341 0.107 0.114 < dy, < 0.568 
Qu23 OF 057, 0.093 = ds = 0,334 
Of 139 0.044 0.035% < re < Whe 44) 
ge) 02031 0.038 = do S 0.168 

COMPONENTS 


Group ls lew 
GEOUD@2 sro, 6 eee mls ad, 


—— a ~ ee a 


| 4 


wv @ © o won Doe 
4 
cS 


_ BRMANOTHOD. 
§ .f 21 qoom- 
Y. pO pe eh E38 


J 


ATTENTION TASK VARIABLE TWO - DIFFERENCE 


TRIAL LOADINGS 


B 
COMPONENT 
TRIAL 1 2 3 4 s) 6 7 
a =O, 023 =Orelo -0.072 0.143 -0.268 0.145 -0.056 
a Oss. 0.236 -0.264 =n 0.076 Osi 0.056 
3 Oma 0 0.013 N53.L6 —0.112 -0.161 0.007 05120 
4 0.185 -0.546 Oe? =0.219 0.106 0.088 =O 01,0 
2 07652 0.118 -0.141 -0.187 -0.132 -0.138 O70 
6 Oar 0.270 0.244 0.260 0.083 0.024 =) Sy) 
7 ll esliy ge} 0.642 0.162 —Oeog =), 03) 0.074 -0.068 
COMPONENT SCORES 
Y' 
COMPONENT 
PERSON 1 2 5 4 3) 6 7 
dL =O. 202 Loo 1.035 5 S55) i755 = SOO 12192 
2 -0.602 1.584 1.428 =-12/45 0.828 O4205 =1 5366 
3) Wid bey) 0.283 ails 485) 0.682 1.264 0.574 -0.386 
4 -0.040 0.326 -0.821 03333 1.402 —OR0S2 Pe \ayile) 
5 2.851 ZO =O7246 0.564 -0.410 AN Sake —05592 
6 0.140 O20st 0.371 —0'9136 0.443 -0.596 0.439 
ql a ee/ lee li) Une -0.444 aa OA =Q30 39 -0.481 0.584 
8 -0.429 =0 5102) -0.010 0.142 =O 9990 -07906 0 4293 
) ee 2 0.247 -3.061 -0.676 0.940 =iLoo = Deoulez, 
10 OP 9 0.402 —1 5069 -0.490 1.098 3.086 0.738 
11 0.330 0.546 OSI9D =F Oy, -0.804 0.550 OR Ra 
12 =1 3580 241,56 -1.148 -0.174 =2 12.31 0.343 0.950 
13 -0.578 0.390 AVG USE) =1.722 0.169 0.071 Orig, 
14 LaLa -0.847 -0.856 -0.420 -0:659 lly MENS) Von 
15 -0.130 OVI) O93) 0.577 =Orooe 0.310 -0.864 
16 -0.081 -0.188 0.298 -0.084 0.469 =0'067 -0.304 
17 0.015 0.154 -0.214 0.001 0.699 =0 5596 =Q. 023 
18 -2.049 13037 -0.056 2.241 0.693 cen A) = (epee 
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ATTENTION TASK VARIABLE THREE - MEDIAN LATENCY 


ORIGINAL MATRIX 


xX! 
TRIAL 
PERSON Je 2 3 4 
IL 1.00 1 235 1.10 1320 . 30 
2 TS UES 1.05 ie ele Or95 .10 
3 dite) 1.40 1.45 1 Aw) oe 88) 
4 the 7AM) ig S18) 1s 20 Dev s/o 
=) 00 1.10 1105 iiss) eis) 
6 1.00 0.80 0.80 0.85 ZOD 
ti 0.90 0.70 0.80 0.80 . 80 
8 1.40 a) 1b AW I) a0 
9 LO sel) 1.05 Om 205 
10 0.80 0.90 Io K6) 0.80 EW) 
11 0.80 0.90 0.90 0.90 - 80 
1 West) 0.90 1.00 aoe) Foe) 
13 1.40 120 We AS 1518) ~25 
14 LG 1.00 20 0.85 05 
LS OFS )s) Uees: w00 0.90 aU 
16 10 YC) 30 Wass) Sey) 
-7 te SoM 0) 159) 1.00 0.90 -90 
18 [Beg les lh she) 0.80 Wig 10 
TRIAL Oo Jb galdal 1.08 1.04 205 
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SiL Dice) EV cen. snlads 0.22 0.18 O22 26 


> 


2/0 


90 


ATTENTION TASK VARIABLE THREE - MEDIAN LATENCY 


MEAN CROSS PRODUCT MATRIX 


124 


Xx' /N 
il Z 3 4 z) 6 7. 
10 is220 dae oy deh 97 LOL REY BSS LieLZ eiezolk 
2 ie eo Ve ris HN seeea bi Lee 14.173 1.146 14238 
3 el O7, ee 2d a OF, iE has aa aeee RABI €}s) LEZ05 
4 Li 161 say 7, 1.145 13 9. i beget Bs £0738 ae 92 
5 1715) ees 1.144 LSL32 i< 169 1.094 Ry ae pl 
6 nS a 1.146 1.105 1.078 1.094 Over, 1.149 
Z AMPA 1 she} 1205 i192 gs Pe 1.149 1.342 
CHARACTERISTIC ROOTS 
CHARACTERISTIC Die D.F. MEAN SQUARE 
CONE NENT ROOT NUM. DEN. RATIO 
* 
1 coheed ks: 24 102 160.662, 
2 0.109 22 80 3.664 
3 0.039 20 60 1.674 
4 0.027 18 42 ozs 
5 0.021 16 26 1.636 
6 O70] 14 ins WM apehe 
7 0.010 2 0 0.0 
“Significant FOL F.g5 
CHARACTERISTIC VECTORS 
V 
i Z 3 4 5 6 i 
i 0.382 -0.289 -0.343 0.059 -0.241 -0.237 OP7aL 
2 0.390 -0.409 0.097 -0.442 -0.412 0.488 -0.261 
3 Oma 19 -0.347 -0.271 -0.075 0.776 -0.073 -0.224 
4 0.369 -0.008 -0.141 0.685 -0.324 -0.187 -0.485 
5 023/09 Ono 0.154 Oe 3 Ye On229 0.656 0.296 
6 0235/7 -0.041 0.828 -0.043 0.077 ~0.414 0.080 
7 0.395 0.685 -0.266 -0.464 -0.086 -0.252 ~0.133 
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CHARACTERISTIC ROOTS 
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BEST SINGLE STANDARD INTERVAL 
VALUE DEVIATION beee2. 110 
8.200 Osa61 7.016 < aT =) 95283 
0.105 0.035 003 aes dy = Oe i 9 
0-033 0.008 0.015 < ds =r 07050 
0.026 0.006 On 0 a di =) 0.053 
02033 0.010 0-018 G3 he = 0.054 
0.003 0.001 0-001 as de < 0.004 
(ONS(S's) 0.007 Or049 S ho <== 05047 
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B 
COMPONENT 
TRIAL al 2 3 4 p) 6 ii 
1 15.095 -02095 -0.068 0.010 —0%035 -0.025 0.074 
ve AEA lah! 6 al 1815) OnOLS =A 0) AOS) -0.060 0.050 =O. 026 
3 1.085 —OO1LE5 -02053 -0.012 Ogl1s8 -0.008 =02023 
4 059 -0.003 -0.028 OR LS -0.047 =Oe0L9 -0.049 
3) 1.068 ORI3i 0.030 0.055 020338 0.068 0.030 
6 1.024 —O2 013 Geos =07 007 0.011 -0.043 0.008 
i} i132 0.226 —O8052 —O8007 -O02012 -02026 -0,013 
COMPONENT SCORES 
y'! 
COMPONENT 
PERSON il Z 3 4 5 6 7 
1 2 hes Th PAS 40) =O no cl 7a bal =08 695 1.034 -2.045 
2 0.951 -0.598 tb ly) 0.435 oO oe 1.466 O27:95 
3 17105 —1°508 ORr73 0.634 1¥O023 0.688 -0.749 
4 0.945 -1.284 -—0.594 =H HOMES) =0.15) -0.128 0.067 
5 259 2.413 290 0.830 0.405 1.460 =) 256 
6 WEEE} -0.144 —OeneuE 0.628 —(0).266 -0.380 1eoou 
7 0.725 -0.089 =Oe loz 0.706 0.220 =OR 220 L¥O037 
8 1096 -1.496 ens, 0.516 oe LOD sya = eG 
9 Or 2S7 -0.434 LOL? -0.106 ORLS2 =O cae Os ote 
10 OSSL7 0), Shey) 0.369 0.021 1629 0.347 =O-518 
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M3 L203 GrooL st OF oF 3 ~1. 288 0.090 =1°5438 1.348 
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18 1 0OL -~0.408 eo zie -0.421 —1,/28 Oe anu 1.494 
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ATTENTION TASK VARIABLE FOUR - STANDARD DEVIATION 


ORIGINAL MATRIX 


xX! 
TRIAL 
PERSON al 2 3) 4 5 6 ioe 
i a A8) 220 0.42 0.86 0.58 0.86 3729 
2 1.46 0.35 0.40 On Org 0.34 4.16 
3 0.42 Osx fs) Ure 0.41 39 0.84 0.28 
4 OLS 0.80 0.48 0.47 0.94 0.30 B) P28) 
5) Of>9 4.12 0.85 Se 2200 4.40 2.03 
6 O73 O.d1 0.20 Ori/ 0.14 0.16 OF14 
7 OF29 Omzy e224 On2) 0.07 hes. o}6} 1.14 
8 OZ O62 0.48 0.76 (Osa Ke: Osa2 0525 
9 0.82 He 38) Phe Shs) On92 0.84 142 0.86 
10 3s) 2490 0.38 0.34 Og 0.26 0.19 
vk 0.17 0.28 oe 0.49 O733 O28 0.66 
12 ISOs Qes2 0.43 ae is) Wei) OBST) 4.13 
is 0.41 D222 0.47 Oe 32 Oe RS) 0.94 0.66 
14 Omi Lk Ae AY) OL 0.64 i ea Orne en 
15 0.34 Or23 0.48 O47) Oe 0.24 (ORR IS 
16 Wee 63 (OR) Ors 0.31 OSI) 6 ee a) ies 
iy) 0.34 OrEz 0.19 0.24 hy Al Oni? W)dhte 
18 0.96 4.28 am teW i ZO 2.48 ee U Aca ly 
TRIAL 0.63 LeLO Oh 8) 0.85 0.69 Urge de Us 8) 
MEANS 
SiDe) DEVa) 0.36 Weck Ons. 00 0.74 Ma) 15.36 
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MEAN CROSS PRODUCT MATRIX 
Xx'/N 


1 2 3 4 5 6 7 
Sa Weer -erienne— = ) dergungen eS e 8 ). eee 
1 D¥525 | 0.805VIATEONS16 0.700 0.500 2.196.654. 1.206 
2 GSS 05 eee (O70 NE 527 eet e570 OG 77 
3 Pesto «1.3273-2581.069 0.904 2.440.831" 40.978 16.1070 
4 F700" 14795 een 01904 1.7404 4509172, «115975 «1,958 
5 OSSOOMMmE S20 we OeS310 5 FOrolzg 033° eon, "as taz 
6 0.654 1.906 0.978 1.397 1.201 1.908 1.851 
7 1 206° 99° 2.0225 syg1070.. 1.958, se187, 11851 , 3,542 
CHARACTERISTIC ROOTS 
CHARACTERISTIC Dev D.F. MEAN SQUARE 
Seton ROOT NUM. DEN. RATIO 
* 
1 9.773 24 102 13.918, 
2 1.525 22 80 3.800 
3 0.535 20 60 1.734 
4 0.445 18 42 2.164 
5 0.300 16 26 2.708 
6 0.121 14 12 1.768 
7 0.059 12 0 0.0 
“Significant for F.gs 
CHARACTERISTIC VECTORS 
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1 2 3 4 5 6 7 
1 0.197 0.166 0.127 -0.274 0.170 0.226 0.873 
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3 Ci cima e 7s UNZIEEeOor10" 8 01G98 veO.sse) | -O.auy 
4 0.367 0.208 0.693  -0.091 -0.564 0.121 0.029 
5 Gercou=0r282h) 01026) 02015: «01276 0y829 01271 
6 Ge00k Or ome sO'GIS8 © )uyo42) 0.426" 01208 | ai82 
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ATTENTION TASK VARIABLE FOUR - STANDARD DEVIATION 


CHARACTERISTIC ROOTS 


BEST SINGLE STANDARD INTERVAL 
VALUE DEVIATION t= 2.110 
9.305 BeZoo 2.441 < dt = 116.166 
je Sy! 0.580 0.174 < hy < 2,020 
0.341 0.132 0.062 < he = 0.620 
0.530 Omi 7? O2167 < hy, = - 075392 
O27 96 0.247 0.274 < he Se pc hy 
0.268 02079 OnLO2 < he = 03434 
OsLZ 1: 0.037 0.043 < ho ie Oral USI) 
COMPONENTS 
Group 1: 1 
Groupee see 


Group e3s0) 3. 643, = 58 0 
Group 4: 7 
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B 
COMPONENT 
TRIAL i 2 3 4 2) 6 7 
dl 0.617 0.204 AG OE)8) Oo 0.093 CS079 Oe 212 
2 lig ees) ANeferiik =0593) 0.006 SUMO 2 =( 7095 OF015 
3 0.816 =03293 02169 -0.474 O22 =) F29 -0.045 
4 Velay 0.256 0) 10Y/ -0.060 -0.309 0.042 0.007 
2) OFS95 -0.348 On0L9 0.010 Oni: ORZ39 -0.066 
6 Jig “eab -0.204 On229 0.428 OF 203 -0.104 0.044 
7 18 py) 0.848 Aba 41) OF0L0 ORs 6 AG) 82S =O 50/9 
COMPONENT SCORES 
Val 
COMPONENT 
PERSON i 2 3 4 5 6 Hi 
1 io 2) 0.648 -2.142 =Oraebs -0.888 == (0) 0.740 
zs 1.000 1 MEK = US soos 1253 0.284 -0.284 
3 0.454 -0.401 Oe 22 0.078 Ne ID 2.268 SOON 
4 0.436 05 SID) =O20L0 -0.574 0.160 Us as) 9) 
5) Pe PAVE eh SHS} = ened. SmUlz OG 2A) 0.108 -0.108 
6 Oeb28 —0.003 Oo Nea =40) 5 27K) OaLo7 0.206 0.981 
7 0.478 0.360 Oe Oval OnuZ2 LOS, AES) 0.476 
8 U3) -0.108 0.456 0), S818) SO 45) =0.156 2.3/4 
9 0.966 -0.670 0.862 =—1.58/7 URS CWAS) call Spell) 0.608 
10 O25 32 = 066 a Batis) —Olne2 -1.885 rally Bt) 0.683 
11 0.483 -0.104 0.745 -0.622 1.264 -1.346 (eu) 
IZ L602 2D, 2035 0.360 SEY 0.024 -0.054 
LS 0.386 0.120 Ole Si O23 0.893 -05090 0.880 
14 On9L5 Mo esth2 -0).665 =O od. 0.668 0.829 =n On 
5 Onze. -0.043 0.185 -0.443 0.310 -0.038 0.579 
16 On2n2 0.010 07053 a=) ere) 0.077 OF833 iS SPAM 
Le] Oela0 0.024 Os ese =, 183 0.148 0.241 0.902 
18 Hc ANALY) -1.469 0.367 OLS SOUS Ono 07, =e 2 
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